-- Logs begin at Fri 2022-08-19 17:55:14 UTC, end at Fri 2022-08-19 19:49:49 UTC. -- Aug 19 19:22:32.695532 dv-osbrick-853458-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 19:22:32 2022] *** Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: nodename: dv-osbrick-853458-2-ceph Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: machine: x86_64 Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: clock source: unix Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: pcre jit disabled Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: detected number of CPU cores: 4 Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: current working directory: / Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: detected binary path: /usr/bin/uwsgi-core Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: your processes number limit is 47680 Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: your memory page size is 4096 bytes Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: detected max file descriptor number: 2048 Aug 19 19:22:32.707158 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: lock engine: pthread robust mutexes Aug 19 19:22:32.708409 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: thunder lock: enabled Aug 19 19:22:32.708409 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 19:22:32.708409 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 19:22:32.751486 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: Python main interpreter initialized at 0x564b6a7a39c0 Aug 19 19:22:32.751486 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: python threads support enabled Aug 19 19:22:32.751486 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: your server socket listen backlog is limited to 100 connections Aug 19 19:22:32.751486 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: your mercy for graceful operations on workers is 90 seconds Aug 19 19:22:32.751999 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 19:22:32.752129 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: *** Operational MODE: preforking *** Aug 19 19:22:32.752565 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: *** uWSGI is running in multiple interpreter mode *** Aug 19 19:22:32.752565 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: spawned uWSGI master process (pid: 123553) Aug 19 19:22:32.752797 dv-osbrick-853458-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 19 19:22:32.755615 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: spawned uWSGI worker 1 (pid: 123562, cores: 1) Aug 19 19:22:32.755615 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: spawned uWSGI worker 2 (pid: 123563, cores: 1) Aug 19 19:22:32.755615 dv-osbrick-853458-2-ceph devstack@keystone.service[123553]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 19:22:37.387213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 19:22:37.387213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: from cryptography.utils import int_from_bytes Aug 19 19:22:37.388025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 19:22:37.388025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: from cryptography.utils import int_from_bytes Aug 19 19:22:37.391865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 19:22:37.391865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: from cryptography.utils import int_from_bytes Aug 19 19:22:37.392372 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 19:22:37.392372 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: from cryptography.utils import int_from_bytes Aug 19 19:22:37.438395 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 19:22:37.438588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 19:22:37.438744 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] command line args: [] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 19:22:37.439054 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 19:22:37.439187 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ================================================================================ {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 19:22:37.439474 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] admin_token = **** {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.439725 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] config_dir = [] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.439886 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.440095 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] config_source = [] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.440261 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] debug = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.440480 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.440851 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.440999 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] insecure_debug = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.441117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 19:22:37.441224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 19:22:37.441318 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.441419 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] command line args: [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 19:22:37.441512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.441617 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 19:22:37.441713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] list_limit = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.441811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ================================================================================ {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 19:22:37.441915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] log_config_append = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.442069 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] admin_token = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.442179 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.442285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] log_dir = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.442390 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] config_dir = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.442484 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] log_file = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.442577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.442577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] config_source = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.442760 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.442894 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] debug = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.442974 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.443038 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.443185 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.443265 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.443387 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.443471 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] insecure_debug = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.443582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.443656 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.443761 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.443878 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.443962 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.444040 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] list_limit = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.444157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.444237 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] log_config_append = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.444345 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.444436 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.444516 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] log_dir = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.444629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.444703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] log_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.444818 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.444899 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.444994 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.445126 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.445280 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.445366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.445483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] notification_format = cadf {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.445608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.445786 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.445918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.445918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.446286 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.446417 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.446515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.446591 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] publish_errors = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.446723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.446816 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.446888 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.447021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.447097 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.447214 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.447287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.447399 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.447555 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.447689 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.447823 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] standard_threads = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.447907 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] notification_format = cadf {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.447988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] strict_password_check = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.448059 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.448217 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.448416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] use_eventlog = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.448625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.448711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] use_journal = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.448795 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] publish_errors = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.448871 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] use_json = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.448948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.449023 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] use_stderr = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.449093 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] use_syslog = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.449168 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.449238 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.449305 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] watch_log_file = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.449506 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.449637 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.449722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.449804 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.449953 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] standard_threads = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.450098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.450176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] strict_password_check = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.450248 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.450417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.450511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.450584 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] use_eventlog = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.450728 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.450809 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] use_journal = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.450878 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] use_json = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.450947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.451054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] use_stderr = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.451207 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.451296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] use_syslog = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.451451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] watch_log_file = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:22:37.451530 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.451695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.451783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.451931 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.452011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.452174 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.452253 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.452408 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.452495 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.452646 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.452725 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.452883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.452963 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.453177 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.453366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.453443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.453666 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.453842 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.453923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.454123 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.454219 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.454377 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.454462 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.454625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.454705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.454858 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.454948 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.455106 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.455300 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.455387 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.455458 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.455566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.455651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.455798 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.455880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.456029 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.456105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.456266 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.456358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.456520 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.456602 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.456764 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.456844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.456996 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.457071 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.457228 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.457309 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.457476 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.457551 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.457725 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.457803 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.457964 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.458069 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.458217 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.458291 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.458449 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.458528 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.458700 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.458805 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.458919 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.459010 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.459164 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.459238 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.459369 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.459447 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.459601 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.459677 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.459829 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.459906 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.460066 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.460146 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.460312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.460387 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.460542 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.460618 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.460779 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.460862 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.461006 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.461082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.461239 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.461317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.461471 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.461546 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.461700 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.461782 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.461927 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.462055 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.462181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.462258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.462411 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.462488 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.462647 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.462723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.462883 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.462959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.463108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.463183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.463337 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.463429 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.463561 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.463637 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.463793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.463884 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.464026 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.464103 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.464254 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.464339 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.464486 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.464567 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.464721 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.464799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.464954 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.465030 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.465187 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.465272 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.465420 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.465505 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.465658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.465739 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.465885 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.465961 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.466155 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.466247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.466390 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.466473 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.466625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.466702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.466855 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.466941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.467091 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.467168 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.467334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.467416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.enabled = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.467564 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.467653 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.467798 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.467912 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.468031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.468107 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.468268 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.468358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.468507 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.468585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.468775 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.469002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.469160 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.469259 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.469321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.469480 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.469561 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.469721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.469798 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.469966 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.470107 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.470224 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.470301 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.enabled = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.470468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.470544 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.470698 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.470773 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.470930 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.471023 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.471163 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.471245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.471391 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.471494 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.471622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.471746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.471859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.471982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.472096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.472217 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.472326 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.472477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.472554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.472723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.472807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.472959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.473045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.473193 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.473269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.473496 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.473571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.473756 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.473835 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.474032 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.474115 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.474253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] auth.external = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.474329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.474482 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.474564 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] auth.mapped = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.474714 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.474791 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.474945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.475021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.475180 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.475258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] auth.password = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.475410 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.475486 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] auth.token = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.475658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.475737 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.475895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.475974 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] catalog.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.476143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.476258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.476382 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.476494 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.476639 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.476747 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.476901 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.477003 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.477140 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.477223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.477371 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] auth.external = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.477449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] credential.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.477599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] auth.mapped = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.477683 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] credential.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.477896 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.477974 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.478159 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.478240 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.478391 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] auth.password = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.478471 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.478620 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] auth.token = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.478697 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.478857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.478982 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.479091 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] catalog.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.479170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.479336 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.479413 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.479566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.479642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.479813 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.479893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.480060 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.480137 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.480290 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.480367 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.480525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] credential.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.480604 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.480771 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] credential.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.480847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.481022 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.481112 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.481269 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.481347 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] federation.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.481504 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.481580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.481745 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.481833 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] federation.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.481978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.482113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.482263 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.482342 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.482515 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.482601 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.482749 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.482825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.483002 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.483091 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.483242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.483328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.483501 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.483578 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.483740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.483827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.483990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.484075 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.484279 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.484357 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.484618 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.484875 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.484985 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] federation.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.485136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.485238 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.485340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.485494 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] federation.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.485593 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.485748 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.485834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.486075 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.486158 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.486259 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.486337 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.486498 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.486587 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.486753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.486830 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.486997 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.487121 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.487228 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.487319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.487474 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.487556 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.487721 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.487799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.487958 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.488046 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.488208 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.488288 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.488455 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.488533 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.488689 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.488775 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.488927 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.489024 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.489176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.489254 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.489405 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.489492 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.489641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.489718 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.489870 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.489948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.490130 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.490211 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.490378 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.490456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.490606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.490692 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.490836 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.490913 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.491075 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.491161 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.491317 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.491394 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.491563 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.491643 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.491805 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.491883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.492046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.492123 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.492293 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.492372 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.492524 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.492602 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.492760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.492842 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.492989 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.493078 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.password = **** {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.493223 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.493302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.493451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.493532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.493686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.493766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.493921 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.494035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.494181 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.494260 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.494426 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.494518 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.494658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.494744 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.494895 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.494973 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.495127 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.495207 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.495360 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.495451 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.495612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.495695 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.495844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.495934 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.496080 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.496185 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.496440 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.496598 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.496675 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.496738 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.password = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.496800 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.496859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.497045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.497134 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.497298 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.497410 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.497610 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.497690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.497893 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.497976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.498145 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.498269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.498421 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.498500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.498685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.498789 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.498978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.499147 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.499270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.499345 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.499416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.499477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.499704 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.499791 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.500174 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.500328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.500525 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.500707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.500848 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.500971 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.501137 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.501279 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.501413 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.501546 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.501689 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.501836 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.501971 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.502132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.502267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.502414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.502549 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.502689 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.502822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.502956 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.503088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.503229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.503363 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.503496 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.503496 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.503758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.503891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504167 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] policy.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504431 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504507 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504789 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] receipt.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.504999 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.505068 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.505139 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.505209 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.505278 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.505348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.505470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.505556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.505709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.505788 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.505943 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.506049 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] resource.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.506209 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.506299 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.506453 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.506538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] resource.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.506690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.506768 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.506923 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.507008 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.507177 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] policy.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.507260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.507405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.507483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] revoke.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.507651 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.507737 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.507887 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.507964 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.508121 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] receipt.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.508199 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] role.cache_time = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.508356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.508507 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] role.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.508604 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.508672 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] role.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.508836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] role.list_limit = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.508911 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.509062 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.509237 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.509320 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.509449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.509527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] resource.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.509654 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.509754 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.509887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.510026 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] resource.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.510148 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.510247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.510408 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.510529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.510659 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.510782 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.511028 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] revoke.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.511149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.511272 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.511420 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.511544 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.511667 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.511790 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] role.cache_time = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.511912 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.512035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] role.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.512165 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.512245 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] role.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.512357 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] role.list_limit = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.512481 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.512603 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.512734 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.512858 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.512990 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.513115 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.513238 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.513361 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.513492 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.513617 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.513740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.513862 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.513984 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.514201 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.514334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.514460 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.514583 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.514717 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.514841 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.514964 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.515094 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.515217 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.515340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.515518 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.515651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.515834 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.515982 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.515982 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.515982 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.516326 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.516461 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.516586 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.516717 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.516841 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] token.cache_time = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.516963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.517086 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] token.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.517208 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.517330 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.517461 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.517585 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] token.provider = fernet {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.517708 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.517830 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.517952 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.518105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.518240 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.518365 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.518488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.518613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.518736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.518866 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.518990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.519111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.519262 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.519381 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] trust.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.519505 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.519643 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.519769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.519903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.520026 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.520148 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.520271 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.520401 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.520524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.520647 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.520771 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.520894 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.521016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] token.cache_time = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.521146 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.521270 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] token.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.521392 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.521523 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.521646 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.connection = **** {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.521778 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] token.provider = fernet {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.521910 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.522049 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.522181 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.522302 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.522422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.522541 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.522661 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.522781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.522908 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.523029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.523148 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.523276 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.523398 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.523517 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] trust.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.523650 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.523770 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.523890 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.524008 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.524129 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.524248 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.524374 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.524494 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.524614 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.524733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.524851 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.524984 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.525112 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.525232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.525355 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.525474 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.525593 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.525712 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.connection = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.525843 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.525977 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.526167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.526290 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.526413 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=123562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 19:22:37.526537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.526537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.526537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.526537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.526537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.527116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.527116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.527345 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.527474 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.527635 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.527883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.528117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.528363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.528592 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.528832 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.529066 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:22:37.529234 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 19:22:37.555098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.555330 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.555554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.558776 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.559010 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.559236 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.564330 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.568380 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.593620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.593865 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.594873 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.595096 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.645824 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.646429 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.695188 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.695504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.696781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.696961 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.761170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.761461 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.761609 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.761691 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.761810 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.761951 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.762072 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.762205 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.762286 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.762350 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.762420 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.762504 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.785305 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.785583 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.785815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.785938 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.786115 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.786200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.786263 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.786382 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.786459 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.786542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.786617 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.786763 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.786972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.787179 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.798324 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.798949 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.811116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.811297 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.811393 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.811522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.811623 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.811746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.811861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.811975 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.812052 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.812124 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.812198 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.812503 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.812722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=123563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.812892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=123562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:22:37.830113 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.830325 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 19:22:37.830448 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.830585 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 19:22:37.830663 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.830852 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 19:22:37.830995 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.831135 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.831215 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 19:22:37.831335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.831412 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.831613 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.831740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.831878 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.831958 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.832150 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.841287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.841561 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.841684 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.841835 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.841963 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.842102 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.842211 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.842465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.849187 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.849452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.852072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.852353 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.852476 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.852620 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.852747 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.852871 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.852950 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.853166 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.853291 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.853450 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.853578 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.853707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.853799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.853921 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.854065 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.854214 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.854345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.854553 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.854886 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.855015 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.855015 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.877872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.879360 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.879484 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.879628 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.880869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.881172 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.884129 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.884406 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.885704 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.886023 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.886344 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.886491 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.892957 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.893084 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.893219 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.893306 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.897265 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.897414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.897617 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.897745 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.897881 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.898029 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.898224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.898316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.898523 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.898649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.898798 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.898940 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.899024 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.899165 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.899325 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.899456 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.914883 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.915166 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.915464 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.915743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.919408 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.919980 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.922911 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.923324 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.923547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.924063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.927694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.929811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.930819 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.932972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.933926 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.934252 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.934540 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.934944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.935228 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.935523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.936072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.936369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.936640 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.937059 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.937444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.938158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.951751 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.951989 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.952261 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.952545 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.954444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.954726 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.955001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.955247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.959466 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.961121 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.961402 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.961946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.963691 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.963976 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.964100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.964355 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.964655 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.964953 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.965219 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.966611 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.966895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.967184 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.967463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.967760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.976500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.976789 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.977075 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.977362 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.977648 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.977926 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.978239 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.979319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.979605 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.979892 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.980180 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.980464 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.980768 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.981049 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:37.993744 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.996677 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.996803 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.999731 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:37.999942 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.001439 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.002964 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:38.003249 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.003511 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.003703 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.005143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.007422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:38.007709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.007998 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.010017 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.011485 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:38.014368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.014494 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.014628 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.014950 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.015254 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.016004 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:38.018978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.019274 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.019557 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.019839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.024456 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:38.024748 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.025039 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.027709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:38.028001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.028276 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.031920 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=123562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:38.032361 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.032682 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.032976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.033258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.033546 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.033805 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.034147 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.034423 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.034707 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.034980 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.035228 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.035511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.035597 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=123563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:22:38.035790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=123562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.036813 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.037105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.037387 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.037668 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.037942 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.038258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.038529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.038816 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.039109 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.039366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.039629 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.039906 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.040167 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=123563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:22:38.068997 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b6a7a39c0 pid: 123562 (default app) Aug 19 19:22:38.072527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee6742-f0da-417d-9542-a9d196ada422 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:38.072815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee6742-f0da-417d-9542-a9d196ada422 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:38.073087 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee6742-f0da-417d-9542-a9d196ada422 None None] PATH_INFO: `/v3` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:38.074127 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b6a7a39c0 pid: 123563 (default app) Aug 19 19:22:38.077317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Fri Aug 19 19:22:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:22:45.179880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195547b9-9572-44e3-b6d3-d3ba8cc42f6c None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:45.180449 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195547b9-9572-44e3-b6d3-d3ba8cc42f6c None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:45.180449 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195547b9-9572-44e3-b6d3-d3ba8cc42f6c None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:45.184802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:22:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:22:45.192120 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafba93-4203-4768-b824-a6ee4cbf7073 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:45.192817 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafba93-4203-4768-b824-a6ee4cbf7073 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:45.193188 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafba93-4203-4768-b824-a6ee4cbf7073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:45.278466 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: INFO dbcounter [None req-4bafba93-4203-4768-b824-a6ee4cbf7073 None None] Registered counter for database keystone Aug 19 19:22:45.300700 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG oslo_db.sqlalchemy.engines [None req-4bafba93-4203-4768-b824-a6ee4cbf7073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 19:22:45.312600 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writer thread running {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 19:22:45.507004 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG passlib.handlers.bcrypt [None req-4bafba93-4203-4768-b824-a6ee4cbf7073 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=123562) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 19:22:45.507355 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG passlib.handlers.bcrypt [None req-4bafba93-4203-4768-b824-a6ee4cbf7073 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=123562) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 19:22:45.564495 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-4bafba93-4203-4768-b824-a6ee4cbf7073 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:45.566419 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-4bafba93-4203-4768-b824-a6ee4cbf7073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:45.710510 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 19:22:46.247765 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195547b9-9572-44e3-b6d3-d3ba8cc42f6c None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:46.327603 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: INFO dbcounter [None req-195547b9-9572-44e3-b6d3-d3ba8cc42f6c None None] Registered counter for database keystone Aug 19 19:22:46.354522 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG oslo_db.sqlalchemy.engines [None req-195547b9-9572-44e3-b6d3-d3ba8cc42f6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 19:22:46.363834 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writer thread running {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 19:22:46.484830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195547b9-9572-44e3-b6d3-d3ba8cc42f6c None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:46.490365 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831500b4-28a3-442b-b0c4-07758dacc40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:46.491017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831500b4-28a3-442b-b0c4-07758dacc40f admin admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:46.491294 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831500b4-28a3-442b-b0c4-07758dacc40f admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:46.491569 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831500b4-28a3-442b-b0c4-07758dacc40f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:46.501012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831500b4-28a3-442b-b0c4-07758dacc40f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:46.552006 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: WARNING keystone.common.rbac_enforcer.enforcer [None req-831500b4-28a3-442b-b0c4-07758dacc40f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 19:22:46.552342 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831500b4-28a3-442b-b0c4-07758dacc40f admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:46.562918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Fri Aug 19 19:22:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 19:22:46.569373 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafba93-4203-4768-b824-a6ee4cbf7073 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:46.588314 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafba93-4203-4768-b824-a6ee4cbf7073 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:46.593460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00af56-1e92-4886-a41d-d928ea5409a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:46.594835 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00af56-1e92-4886-a41d-d928ea5409a9 admin admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:46.595123 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00af56-1e92-4886-a41d-d928ea5409a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:46.595390 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00af56-1e92-4886-a41d-d928ea5409a9 admin admin] PATH_INFO: `/v3/projects/5477f1d1785b40499847c6f71cd220c2` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:46.596989 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00af56-1e92-4886-a41d-d928ea5409a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=5477f1d1785b40499847c6f71cd220c2)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:46.647832 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3b00af56-1e92-4886-a41d-d928ea5409a9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 19:22:46.648145 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00af56-1e92-4886-a41d-d928ea5409a9 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:46.652907 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Fri Aug 19 19:22:46 2022] GET /identity/v3/projects/5477f1d1785b40499847c6f71cd220c2 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:22:48.822966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14120a89-6e02-4a64-9cbb-265f86e8ff58 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:48.823876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14120a89-6e02-4a64-9cbb-265f86e8ff58 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:48.823876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14120a89-6e02-4a64-9cbb-265f86e8ff58 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:48.829763 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:22:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:48.835457 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751e8b2-7608-4808-9b23-f4b16d599359 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:48.835900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751e8b2-7608-4808-9b23-f4b16d599359 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:48.836004 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751e8b2-7608-4808-9b23-f4b16d599359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:48.857239 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-1751e8b2-7608-4808-9b23-f4b16d599359 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:48.858799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-1751e8b2-7608-4808-9b23-f4b16d599359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:48.868482 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 19:22:49.200977 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14120a89-6e02-4a64-9cbb-265f86e8ff58 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:49.222306 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14120a89-6e02-4a64-9cbb-265f86e8ff58 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:49.227636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aaa1e4-6b0d-475e-9858-f8ce31a78395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:49.228251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaa1e4-6b0d-475e-9858-f8ce31a78395 admin admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:49.228529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaa1e4-6b0d-475e-9858-f8ce31a78395 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:49.228798 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaa1e4-6b0d-475e-9858-f8ce31a78395 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:49.236927 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aaa1e4-6b0d-475e-9858-f8ce31a78395 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:49.238755 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aaa1e4-6b0d-475e-9858-f8ce31a78395 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:49.247698 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Fri Aug 19 19:22:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 19:22:49.253648 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751e8b2-7608-4808-9b23-f4b16d599359 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:49.263393 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751e8b2-7608-4808-9b23-f4b16d599359 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:49.269338 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae947b-98cf-4ac8-909f-feef47fe5663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:49.269974 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae947b-98cf-4ac8-909f-feef47fe5663 admin admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:49.270286 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae947b-98cf-4ac8-909f-feef47fe5663 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:49.270556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae947b-98cf-4ac8-909f-feef47fe5663 admin admin] PATH_INFO: `/v3/users/9d26dacccf744cb7a2a26549ace91be1` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:49.272025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae947b-98cf-4ac8-909f-feef47fe5663 admin admin] RBAC: Authorizing `identity:get_user(user_id=9d26dacccf744cb7a2a26549ace91be1)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:49.273883 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae947b-98cf-4ac8-909f-feef47fe5663 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:49.275455 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Fri Aug 19 19:22:49 2022] GET /identity/v3/users/9d26dacccf744cb7a2a26549ace91be1 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:22:51.525193 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2621423-f10d-406b-85db-c21f4bb8de3d None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:51.525731 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2621423-f10d-406b-85db-c21f4bb8de3d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:51.525731 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2621423-f10d-406b-85db-c21f4bb8de3d None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:51.527088 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:51.532697 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4b391-63fe-40d6-93ea-7a28f059c7c0 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:51.533148 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4b391-63fe-40d6-93ea-7a28f059c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:51.533240 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4b391-63fe-40d6-93ea-7a28f059c7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:51.552874 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-4fd4b391-63fe-40d6-93ea-7a28f059c7c0 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:51.554123 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-4fd4b391-63fe-40d6-93ea-7a28f059c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:51.598852 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec58a5-31f3-45da-865d-eee2b12496dc None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:51.599089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec58a5-31f3-45da-865d-eee2b12496dc None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:51.599390 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec58a5-31f3-45da-865d-eee2b12496dc None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:51.600886 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:51.606057 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d964537-2c07-481c-8f38-eebd1d3ae43a None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:51.606359 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d964537-2c07-481c-8f38-eebd1d3ae43a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:51.606630 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d964537-2c07-481c-8f38-eebd1d3ae43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:51.653645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG passlib.handlers.bcrypt [None req-5d964537-2c07-481c-8f38-eebd1d3ae43a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=123563) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 19:22:51.654109 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG passlib.handlers.bcrypt [None req-5d964537-2c07-481c-8f38-eebd1d3ae43a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=123563) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 19:22:51.700464 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-5d964537-2c07-481c-8f38-eebd1d3ae43a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:51.702191 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-5d964537-2c07-481c-8f38-eebd1d3ae43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:51.758760 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:22:51.805056 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:22:52.088901 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4b391-63fe-40d6-93ea-7a28f059c7c0 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:52.113683 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:52.119507 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d964537-2c07-481c-8f38-eebd1d3ae43a None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:52.198128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4b391-63fe-40d6-93ea-7a28f059c7c0 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:52.224055 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d964537-2c07-481c-8f38-eebd1d3ae43a None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:52.226427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:52.234751 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b51f43-aa1c-42fc-bbc2-ace44784e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:52.235453 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b51f43-aa1c-42fc-bbc2-ace44784e472 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:52.235828 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b51f43-aa1c-42fc-bbc2-ace44784e472 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:52.236167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b51f43-aa1c-42fc-bbc2-ace44784e472 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:52.247939 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b51f43-aa1c-42fc-bbc2-ace44784e472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-b2b51f43-aa1c-42fc-bbc2-ace44784e472 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:22:52.256918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:22:52.258064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:22:52.258900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:22:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:22:52.263815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b51f43-aa1c-42fc-bbc2-ace44784e472 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:52.269022 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8051b4b-641c-441e-b560-1b47161ad3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:52.269924 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8051b4b-641c-441e-b560-1b47161ad3b2 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:52.270230 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8051b4b-641c-441e-b560-1b47161ad3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:52.270513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8051b4b-641c-441e-b560-1b47161ad3b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:52.341894 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8051b4b-641c-441e-b560-1b47161ad3b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:52.343370 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8051b4b-641c-441e-b560-1b47161ad3b2 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:52.347873 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:52.367832 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b51f43-aa1c-42fc-bbc2-ace44784e472 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:52.401221 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbdc1e-b9f1-463c-8057-c95f6f4b0075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:52.401821 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbdc1e-b9f1-463c-8057-c95f6f4b0075 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:52.402138 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbdc1e-b9f1-463c-8057-c95f6f4b0075 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:52.402407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbdc1e-b9f1-463c-8057-c95f6f4b0075 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:52.403059 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbdc1e-b9f1-463c-8057-c95f6f4b0075 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:22:52.403352 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbdc1e-b9f1-463c-8057-c95f6f4b0075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:52.404755 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbdc1e-b9f1-463c-8057-c95f6f4b0075 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:52.416932 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:22:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:22:52.422800 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbdc1e-b9f1-463c-8057-c95f6f4b0075 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:52.446417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:22:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:22:52.452006 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8051b4b-641c-441e-b560-1b47161ad3b2 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:52.455895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:52.526997 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbdc1e-b9f1-463c-8057-c95f6f4b0075 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:52.551185 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8051b4b-641c-441e-b560-1b47161ad3b2 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:52.563158 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ca67e-4970-424a-a179-1bf713856b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:52.563737 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ca67e-4970-424a-a179-1bf713856b61 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:52.564045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ca67e-4970-424a-a179-1bf713856b61 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:52.564284 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ca67e-4970-424a-a179-1bf713856b61 None admin] PATH_INFO: `/v3/users/9d26dacccf744cb7a2a26549ace91be1` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:52.565498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ca67e-4970-424a-a179-1bf713856b61 None admin] RBAC: Authorizing `identity:get_user(user_id=9d26dacccf744cb7a2a26549ace91be1)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:52.566991 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ca67e-4970-424a-a179-1bf713856b61 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:52.568760 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:22:52 2022] GET /identity/v3/users/9d26dacccf744cb7a2a26549ace91be1 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:22:52.574014 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ca67e-4970-424a-a179-1bf713856b61 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:52.588544 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddf369-3eaa-4e8f-a265-dede1abe7509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:52.589151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:52.589423 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddf369-3eaa-4e8f-a265-dede1abe7509 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:52.589703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddf369-3eaa-4e8f-a265-dede1abe7509 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:52.590015 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddf369-3eaa-4e8f-a265-dede1abe7509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:52.609088 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddf369-3eaa-4e8f-a265-dede1abe7509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:52.610574 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddf369-3eaa-4e8f-a265-dede1abe7509 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-c6ddf369-3eaa-4e8f-a265-dede1abe7509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:22:52.629853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:22:52.630963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:22:52.631849 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:22:52.631849 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:22:52.631849 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:22:52.631849 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:22:52.636942 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddf369-3eaa-4e8f-a265-dede1abe7509 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:52.679840 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ca67e-4970-424a-a179-1bf713856b61 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:52.696035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:52.714404 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dbf1a-9624-41e8-ae78-9ad90a862e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:52.715044 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dbf1a-9624-41e8-ae78-9ad90a862e43 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:52.715325 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dbf1a-9624-41e8-ae78-9ad90a862e43 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:52.715601 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dbf1a-9624-41e8-ae78-9ad90a862e43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:52.716752 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141dbf1a-9624-41e8-ae78-9ad90a862e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:52.718390 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141dbf1a-9624-41e8-ae78-9ad90a862e43 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:52.720365 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:22:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:22:52.726265 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dbf1a-9624-41e8-ae78-9ad90a862e43 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:52.817464 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:52.841624 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dbf1a-9624-41e8-ae78-9ad90a862e43 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:52.854566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddf369-3eaa-4e8f-a265-dede1abe7509 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:52.877131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3af5a9-6f77-4a99-a67c-3e15d70d5486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:52.877666 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3af5a9-6f77-4a99-a67c-3e15d70d5486 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:52.877960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3af5a9-6f77-4a99-a67c-3e15d70d5486 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:52.878264 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3af5a9-6f77-4a99-a67c-3e15d70d5486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:52.878985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3af5a9-6f77-4a99-a67c-3e15d70d5486 None admin] RBAC: Adding query filter params (role.id=4ef4b944934e44a28a394ebd1a816f64, scope.domain.id=default, user.id=9d26dacccf744cb7a2a26549ace91be1) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:22:52.879291 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3af5a9-6f77-4a99-a67c-3e15d70d5486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:52.880754 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3af5a9-6f77-4a99-a67c-3e15d70d5486 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:52.887352 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1322 bytes} [Fri Aug 19 19:22:52 2022] GET /identity/v3/role_assignments?user.id=9d26dacccf744cb7a2a26549ace91be1&scope.domain.id=default&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:22:52.888283 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050b976-d8c8-4683-9a70-3e833ac17124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:52.888900 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050b976-d8c8-4683-9a70-3e833ac17124 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:52.889174 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050b976-d8c8-4683-9a70-3e833ac17124 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:52.889441 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050b976-d8c8-4683-9a70-3e833ac17124 None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:52.890171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050b976-d8c8-4683-9a70-3e833ac17124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:22:52.890493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050b976-d8c8-4683-9a70-3e833ac17124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:52.891904 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050b976-d8c8-4683-9a70-3e833ac17124 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:52.912335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 10/21] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:22:55.399999 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08aad5f-cb37-4012-8365-a5a7d15493b8 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:55.400514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08aad5f-cb37-4012-8365-a5a7d15493b8 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:55.400514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08aad5f-cb37-4012-8365-a5a7d15493b8 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:55.402152 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 12/22] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:55.408085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be99bae-3c3d-4b36-b971-7bbe79a2d72f None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:55.408988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be99bae-3c3d-4b36-b971-7bbe79a2d72f None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:55.409468 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be99bae-3c3d-4b36-b971-7bbe79a2d72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:55.434346 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-9be99bae-3c3d-4b36-b971-7bbe79a2d72f None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:55.435899 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-9be99bae-3c3d-4b36-b971-7bbe79a2d72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:55.492764 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31467a-a028-42de-a94b-f2e4bc0093ba None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:55.493361 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31467a-a028-42de-a94b-f2e4bc0093ba None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:55.493821 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31467a-a028-42de-a94b-f2e4bc0093ba None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:55.495613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 13/23] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:55.500810 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad999a-d903-46e4-a492-4af190d949b5 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:55.501419 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad999a-d903-46e4-a492-4af190d949b5 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:55.501901 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad999a-d903-46e4-a492-4af190d949b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:55.531579 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 11/24] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:22:55.543914 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-c4ad999a-d903-46e4-a492-4af190d949b5 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:55.545468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-c4ad999a-d903-46e4-a492-4af190d949b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:55.667202 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 14/25] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:22:55.814498 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaa4d1-22d5-452f-b1f2-224895f563d4 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:55.814879 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaa4d1-22d5-452f-b1f2-224895f563d4 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:55.815047 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaa4d1-22d5-452f-b1f2-224895f563d4 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:55.816585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 12/26] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:55.821601 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc39c2-2c04-44a7-b715-c7d212654c51 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:55.822127 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc39c2-2c04-44a7-b715-c7d212654c51 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:55.822589 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc39c2-2c04-44a7-b715-c7d212654c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:55.850775 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-72cc39c2-2c04-44a7-b715-c7d212654c51 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:55.852311 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-72cc39c2-2c04-44a7-b715-c7d212654c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:55.948257 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 15/27] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:22:56.013216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaa4d1-22d5-452f-b1f2-224895f563d4 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:56.081208 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:56.153787 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaa4d1-22d5-452f-b1f2-224895f563d4 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:56.203063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc39c2-2c04-44a7-b715-c7d212654c51 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:56.213282 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:56.213967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736feb0e-6e1f-4609-8195-26c15ce1c292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:56.214718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736feb0e-6e1f-4609-8195-26c15ce1c292 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:56.214994 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736feb0e-6e1f-4609-8195-26c15ce1c292 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:56.215300 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736feb0e-6e1f-4609-8195-26c15ce1c292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:56.237512 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736feb0e-6e1f-4609-8195-26c15ce1c292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-736feb0e-6e1f-4609-8195-26c15ce1c292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:22:56.244680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:22:56.245534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:22:56.246343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 13/28] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:22:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:22:56.254249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736feb0e-6e1f-4609-8195-26c15ce1c292 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:56.424013 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc39c2-2c04-44a7-b715-c7d212654c51 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:56.434263 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736feb0e-6e1f-4609-8195-26c15ce1c292 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:56.450361 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:56.489940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99756-a3d4-474c-9ba5-b81b8a05ab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:56.490634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99756-a3d4-474c-9ba5-b81b8a05ab9f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:56.490916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99756-a3d4-474c-9ba5-b81b8a05ab9f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:56.491189 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99756-a3d4-474c-9ba5-b81b8a05ab9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:56.497713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ab9bc-be59-4efa-81d1-cfccf080ab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:56.498351 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab9bc-be59-4efa-81d1-cfccf080ab26 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:56.498623 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab9bc-be59-4efa-81d1-cfccf080ab26 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:56.499621 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab9bc-be59-4efa-81d1-cfccf080ab26 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:56.500046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ab9bc-be59-4efa-81d1-cfccf080ab26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:22:56.500342 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ab9bc-be59-4efa-81d1-cfccf080ab26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:56.502426 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ab9bc-be59-4efa-81d1-cfccf080ab26 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:56.503439 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de99756-a3d4-474c-9ba5-b81b8a05ab9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:56.506210 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de99756-a3d4-474c-9ba5-b81b8a05ab9f None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:56.515586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 14/29] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:22:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:22:56.517410 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c25d3-dbd7-484a-ab43-0cc3d92cb8b4 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:56.517957 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c25d3-dbd7-484a-ab43-0cc3d92cb8b4 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:56.518273 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c25d3-dbd7-484a-ab43-0cc3d92cb8b4 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:56.519711 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 15/30] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:56.520397 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c25d3-dbd7-484a-ab43-0cc3d92cb8b4 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-5de99756-a3d4-474c-9ba5-b81b8a05ab9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:22:56.524649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:22:56.525738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:22:56.527706 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:22:56.527706 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:22:56.527706 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:22:56.527706 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 16/31] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:22:56.528138 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99756-a3d4-474c-9ba5-b81b8a05ab9f None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:56.589890 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:56.640831 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99756-a3d4-474c-9ba5-b81b8a05ab9f None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:56.658591 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c25d3-dbd7-484a-ab43-0cc3d92cb8b4 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:56.683306 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa40718-ae13-45a2-b350-4c6ddc55b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:56.684320 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40718-ae13-45a2-b350-4c6ddc55b13e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:56.684744 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40718-ae13-45a2-b350-4c6ddc55b13e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:56.685157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40718-ae13-45a2-b350-4c6ddc55b13e None admin] PATH_INFO: `/v3/users/9d26dacccf744cb7a2a26549ace91be1` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:56.686627 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa40718-ae13-45a2-b350-4c6ddc55b13e None admin] RBAC: Authorizing `identity:get_user(user_id=9d26dacccf744cb7a2a26549ace91be1)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:56.688595 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa40718-ae13-45a2-b350-4c6ddc55b13e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:56.691195 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 17/32] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:22:56 2022] GET /identity/v3/users/9d26dacccf744cb7a2a26549ace91be1 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:22:56.693051 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017fbb7-cb17-469a-a4b6-cf677cb16113 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:56.693680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017fbb7-cb17-469a-a4b6-cf677cb16113 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:56.694312 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017fbb7-cb17-469a-a4b6-cf677cb16113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:56.708697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ad398-f540-4b2f-bdbb-eb877ea3c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:56.709372 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ad398-f540-4b2f-bdbb-eb877ea3c9a7 None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:56.709656 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ad398-f540-4b2f-bdbb-eb877ea3c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:56.709981 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ad398-f540-4b2f-bdbb-eb877ea3c9a7 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:56.710682 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ad398-f540-4b2f-bdbb-eb877ea3c9a7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:56.712096 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ad398-f540-4b2f-bdbb-eb877ea3c9a7 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:56.715967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-2017fbb7-cb17-469a-a4b6-cf677cb16113 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:56.717460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-2017fbb7-cb17-469a-a4b6-cf677cb16113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:56.798100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 18/33] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:22:56.799032 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017fbb7-cb17-469a-a4b6-cf677cb16113 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:56.845221 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 16/34] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Aug 19 19:22:56 2022] POST /identity/v3/roles => generated 219 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:22:56.846538 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ad398-f540-4b2f-bdbb-eb877ea3c9a7 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:56.881498 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:56.891145 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:56.976401 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ad398-f540-4b2f-bdbb-eb877ea3c9a7 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:56.988873 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017fbb7-cb17-469a-a4b6-cf677cb16113 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:57.044728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdb204-a897-47e0-88d8-c00d7e6dbef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:57.045394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdb204-a897-47e0-88d8-c00d7e6dbef5 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:57.045675 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdb204-a897-47e0-88d8-c00d7e6dbef5 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:57.045965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdb204-a897-47e0-88d8-c00d7e6dbef5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:57.051353 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdb204-a897-47e0-88d8-c00d7e6dbef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:57.053040 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdb204-a897-47e0-88d8-c00d7e6dbef5 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:57.054914 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 17/35] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:22:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:22:57.055675 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485f017-15d4-48da-83a8-b1c81673d993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:57.056317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f017-15d4-48da-83a8-b1c81673d993 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:57.056592 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f017-15d4-48da-83a8-b1c81673d993 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:57.056859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f017-15d4-48da-83a8-b1c81673d993 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:57.057511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485f017-15d4-48da-83a8-b1c81673d993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:22:57.057807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485f017-15d4-48da-83a8-b1c81673d993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:57.059308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485f017-15d4-48da-83a8-b1c81673d993 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:57.060788 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdb204-a897-47e0-88d8-c00d7e6dbef5 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:57.078696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 19/36] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:22:57.087118 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485f017-15d4-48da-83a8-b1c81673d993 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:57.237393 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485f017-15d4-48da-83a8-b1c81673d993 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:57.253407 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:57.264090 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdb204-a897-47e0-88d8-c00d7e6dbef5 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:57.264771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:57.301603 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9440100-3c01-4c0b-bbfa-dd4b986af31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:57.302507 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9440100-3c01-4c0b-bbfa-dd4b986af31d None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:57.303104 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9440100-3c01-4c0b-bbfa-dd4b986af31d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:57.303860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9440100-3c01-4c0b-bbfa-dd4b986af31d None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:57.304921 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9440100-3c01-4c0b-bbfa-dd4b986af31d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:57.307031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9440100-3c01-4c0b-bbfa-dd4b986af31d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:57.314732 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6819be-6061-42c4-b915-ce2cc24ecac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:57.315722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6819be-6061-42c4-b915-ce2cc24ecac2 None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:57.315997 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6819be-6061-42c4-b915-ce2cc24ecac2 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:57.316276 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6819be-6061-42c4-b915-ce2cc24ecac2 None admin] PATH_INFO: `/v3/domains/default/users/9d26dacccf744cb7a2a26549ace91be1/roles/4ef4b944934e44a28a394ebd1a816f64` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:57.319129 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6819be-6061-42c4-b915-ce2cc24ecac2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9d26dacccf744cb7a2a26549ace91be1, role_id=4ef4b944934e44a28a394ebd1a816f64)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:57.321042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6819be-6061-42c4-b915-ce2cc24ecac2 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:57.344451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 18/37] 10.222.0.60 () {58 vars in 1361 bytes} [Fri Aug 19 19:22:57 2022] PUT /identity/v3/domains/default/users/9d26dacccf744cb7a2a26549ace91be1/roles/4ef4b944934e44a28a394ebd1a816f64 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:22:57.345776 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08938-62d3-4e3f-a91a-317f9d6b223a None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:57.346288 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08938-62d3-4e3f-a91a-317f9d6b223a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:57.346676 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08938-62d3-4e3f-a91a-317f9d6b223a None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:57.347954 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 19/38] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:57.348667 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e08938-62d3-4e3f-a91a-317f9d6b223a None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:57.492075 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 20/39] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 19:22:57 2022] POST /identity/v3/projects => generated 301 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:22:57.493489 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a3665-3d7c-4ee9-9f26-fa5ee5f251b6 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:57.493770 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a3665-3d7c-4ee9-9f26-fa5ee5f251b6 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:57.494067 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a3665-3d7c-4ee9-9f26-fa5ee5f251b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:57.506975 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e08938-62d3-4e3f-a91a-317f9d6b223a None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:57.514860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-e22a3665-3d7c-4ee9-9f26-fa5ee5f251b6 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:57.516804 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-e22a3665-3d7c-4ee9-9f26-fa5ee5f251b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:57.553798 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557393a-2749-488b-955e-1d9960e8de94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:57.555219 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557393a-2749-488b-955e-1d9960e8de94 None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:57.555758 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557393a-2749-488b-955e-1d9960e8de94 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:57.557714 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557393a-2749-488b-955e-1d9960e8de94 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:57.558804 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557393a-2749-488b-955e-1d9960e8de94 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:57.560482 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557393a-2749-488b-955e-1d9960e8de94 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:57.581540 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 20/40] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Aug 19 19:22:57 2022] POST /identity/v3/roles => generated 225 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:22:57.583031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7368d-6db3-4753-82ae-320a985c48bf None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:57.583386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7368d-6db3-4753-82ae-320a985c48bf None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:57.583664 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7368d-6db3-4753-82ae-320a985c48bf None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:57.585022 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 21/41] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:57.591238 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3c89-c101-4a1d-8387-941552ef1bd8 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:57.591535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3c89-c101-4a1d-8387-941552ef1bd8 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:57.591820 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3c89-c101-4a1d-8387-941552ef1bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:57.611043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 21/42] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:22:57.619054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-75ec3c89-c101-4a1d-8387-941552ef1bd8 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:57.620795 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-75ec3c89-c101-4a1d-8387-941552ef1bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:57.636884 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:57.721027 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 22/43] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:22:57.991096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a3665-3d7c-4ee9-9f26-fa5ee5f251b6 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:58.052330 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec3c89-c101-4a1d-8387-941552ef1bd8 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:58.092954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:58.101317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a3665-3d7c-4ee9-9f26-fa5ee5f251b6 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:58.141266 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92544d19-333d-4f39-b20c-e6b21cb56cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:58.141898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92544d19-333d-4f39-b20c-e6b21cb56cce None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:58.142209 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92544d19-333d-4f39-b20c-e6b21cb56cce None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:58.142481 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92544d19-333d-4f39-b20c-e6b21cb56cce None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:58.143154 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92544d19-333d-4f39-b20c-e6b21cb56cce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:58.144754 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92544d19-333d-4f39-b20c-e6b21cb56cce None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:58.161807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 22/44] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Aug 19 19:22:57 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:22:58.161985 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec3c89-c101-4a1d-8387-941552ef1bd8 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:58.206423 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619f374-ba45-4f47-98f9-9503f6130237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:58.208972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619f374-ba45-4f47-98f9-9503f6130237 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:58.208972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619f374-ba45-4f47-98f9-9503f6130237 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:58.208972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619f374-ba45-4f47-98f9-9503f6130237 None admin] PATH_INFO: `/v3/domains/default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:58.209701 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619f374-ba45-4f47-98f9-9503f6130237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:58.211265 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619f374-ba45-4f47-98f9-9503f6130237 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:58.213119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 23/45] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:22:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:22:58.219557 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92544d19-333d-4f39-b20c-e6b21cb56cce None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:58.338728 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92544d19-333d-4f39-b20c-e6b21cb56cce None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:58.381438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043b1ea-248d-4dfb-8fcf-3da55db9eeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:58.382159 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b1ea-248d-4dfb-8fcf-3da55db9eeb2 None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:58.382387 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b1ea-248d-4dfb-8fcf-3da55db9eeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:58.382614 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b1ea-248d-4dfb-8fcf-3da55db9eeb2 None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:58.383273 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043b1ea-248d-4dfb-8fcf-3da55db9eeb2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:58.384741 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043b1ea-248d-4dfb-8fcf-3da55db9eeb2 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:58.414755 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 19:22:58 2022] POST /identity/v3/projects => generated 312 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:22:59.708671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304497c-0ca6-4374-afda-a545071dda93 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:59.709221 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304497c-0ca6-4374-afda-a545071dda93 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:59.709221 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304497c-0ca6-4374-afda-a545071dda93 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:59.710570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:59.715823 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca073-9512-4784-8dee-fd9516f96516 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:59.716233 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca073-9512-4784-8dee-fd9516f96516 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:59.716359 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca073-9512-4784-8dee-fd9516f96516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:59.740494 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-6bfca073-9512-4784-8dee-fd9516f96516 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:59.741728 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-6bfca073-9512-4784-8dee-fd9516f96516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:59.743789 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:59.814137 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 24/48] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:00.134477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304497c-0ca6-4374-afda-a545071dda93 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:00.152464 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:00.249124 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304497c-0ca6-4374-afda-a545071dda93 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:00.284094 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e17fa-8192-485a-a711-eb5c9f2d1688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:00.284725 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e17fa-8192-485a-a711-eb5c9f2d1688 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:00.285006 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e17fa-8192-485a-a711-eb5c9f2d1688 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:00.285276 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e17fa-8192-485a-a711-eb5c9f2d1688 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:00.295966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e17fa-8192-485a-a711-eb5c9f2d1688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-b33e17fa-8192-485a-a711-eb5c9f2d1688 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:00.300872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:00.301727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:00.302634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 25/49] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:23:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:00.309507 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfca073-9512-4784-8dee-fd9516f96516 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:00.411011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfca073-9512-4784-8dee-fd9516f96516 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:00.446284 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0fd48-cc2e-4574-8024-5d8a0abbec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:00.446890 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0fd48-cc2e-4574-8024-5d8a0abbec4f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:00.447170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0fd48-cc2e-4574-8024-5d8a0abbec4f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:00.447435 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0fd48-cc2e-4574-8024-5d8a0abbec4f None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:00.448093 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0fd48-cc2e-4574-8024-5d8a0abbec4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:00.448386 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0fd48-cc2e-4574-8024-5d8a0abbec4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:00.449780 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0fd48-cc2e-4574-8024-5d8a0abbec4f None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:00.455006 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:00.463435 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 25/50] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:00.464834 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e17fa-8192-485a-a711-eb5c9f2d1688 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:00.547582 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:00.574986 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e17fa-8192-485a-a711-eb5c9f2d1688 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:00.609760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee72b3-f1e5-456d-8be1-cdff7be21b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:00.610428 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee72b3-f1e5-456d-8be1-cdff7be21b8b None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:00.610708 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee72b3-f1e5-456d-8be1-cdff7be21b8b None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:00.610978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee72b3-f1e5-456d-8be1-cdff7be21b8b None admin] PATH_INFO: `/v3/users/9d26dacccf744cb7a2a26549ace91be1` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:00.612153 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee72b3-f1e5-456d-8be1-cdff7be21b8b None admin] RBAC: Authorizing `identity:get_user(user_id=9d26dacccf744cb7a2a26549ace91be1)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:00.613616 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee72b3-f1e5-456d-8be1-cdff7be21b8b None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:00.615493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 26/51] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:00 2022] GET /identity/v3/users/9d26dacccf744cb7a2a26549ace91be1 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:00.621091 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0fd48-cc2e-4574-8024-5d8a0abbec4f None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:00.636241 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f6976-97d3-49e6-b8f9-6214b236a717 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:00.636525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f6976-97d3-49e6-b8f9-6214b236a717 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:00.636803 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f6976-97d3-49e6-b8f9-6214b236a717 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:00.638136 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 27/52] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:00.643258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c5d5-de70-4612-b76e-b2609c92a29b None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:00.643539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c5d5-de70-4612-b76e-b2609c92a29b None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:00.643813 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c5d5-de70-4612-b76e-b2609c92a29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:00.662248 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-e8e9c5d5-de70-4612-b76e-b2609c92a29b None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:00.663398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-e8e9c5d5-de70-4612-b76e-b2609c92a29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:00.730070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0fd48-cc2e-4574-8024-5d8a0abbec4f None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:00.735463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 28/53] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:00.773004 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cde09-53d9-45af-a47b-d164a9af9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:00.773652 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cde09-53d9-45af-a47b-d164a9af9ddf None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:00.773936 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cde09-53d9-45af-a47b-d164a9af9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:00.774251 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cde09-53d9-45af-a47b-d164a9af9ddf None admin] PATH_INFO: `/v3/domains/default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:00.775354 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cde09-53d9-45af-a47b-d164a9af9ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:00.776830 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cde09-53d9-45af-a47b-d164a9af9ddf None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:00.778512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 26/54] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:00.784519 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9c5d5-de70-4612-b76e-b2609c92a29b None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:00.857369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:00.889012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9c5d5-de70-4612-b76e-b2609c92a29b None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:00.925509 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f265f-f90b-4527-ac06-75320dfa5b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:00.926511 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f265f-f90b-4527-ac06-75320dfa5b35 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:00.926870 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f265f-f90b-4527-ac06-75320dfa5b35 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:00.927147 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f265f-f90b-4527-ac06-75320dfa5b35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:00.927894 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f265f-f90b-4527-ac06-75320dfa5b35 None admin] RBAC: Adding query filter params (role.id=4ef4b944934e44a28a394ebd1a816f64, scope.domain.id=default, user.id=9d26dacccf744cb7a2a26549ace91be1) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:00.928495 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f265f-f90b-4527-ac06-75320dfa5b35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:00.930392 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f265f-f90b-4527-ac06-75320dfa5b35 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:00.941071 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 29/55] 10.222.0.60 () {56 vars in 1322 bytes} [Fri Aug 19 19:23:00 2022] GET /identity/v3/role_assignments?user.id=9d26dacccf744cb7a2a26549ace91be1&scope.domain.id=default&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:01.069953 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cde09-53d9-45af-a47b-d164a9af9ddf None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:01.144496 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:01.182747 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cde09-53d9-45af-a47b-d164a9af9ddf None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:01.219340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7541c-7a4a-483a-9cf5-86947010084d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:01.220001 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7541c-7a4a-483a-9cf5-86947010084d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:01.220277 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7541c-7a4a-483a-9cf5-86947010084d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:01.220547 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7541c-7a4a-483a-9cf5-86947010084d None admin] PATH_INFO: `/v3/domains/default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:01.221641 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7541c-7a4a-483a-9cf5-86947010084d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:01.223168 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7541c-7a4a-483a-9cf5-86947010084d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:01.224747 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 27/56] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:01.230620 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f265f-f90b-4527-ac06-75320dfa5b35 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:01.342375 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f265f-f90b-4527-ac06-75320dfa5b35 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:01.384883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e49364-3bec-457b-ae17-def357f48a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:01.385808 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e49364-3bec-457b-ae17-def357f48a25 None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:01.386229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e49364-3bec-457b-ae17-def357f48a25 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:01.386608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e49364-3bec-457b-ae17-def357f48a25 None admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:01.387568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e49364-3bec-457b-ae17-def357f48a25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:01.389837 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e49364-3bec-457b-ae17-def357f48a25 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:01.395997 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:01.424787 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 30/57] 10.222.0.60 () {60 vars in 1140 bytes} [Fri Aug 19 19:23:01 2022] POST /identity/v3/projects => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:23:03.649008 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc514a7b-726f-4450-a22f-5f31f963a817 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:03.649623 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc514a7b-726f-4450-a22f-5f31f963a817 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:03.649623 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc514a7b-726f-4450-a22f-5f31f963a817 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:03.650990 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 28/58] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:03.657466 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af423-7b64-428f-a856-e5903580d48d None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:03.658197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af423-7b64-428f-a856-e5903580d48d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:03.658384 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af423-7b64-428f-a856-e5903580d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:03.682700 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-254af423-7b64-428f-a856-e5903580d48d None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:03.683898 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-254af423-7b64-428f-a856-e5903580d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:03.765898 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 31/59] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:04.090023 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc514a7b-726f-4450-a22f-5f31f963a817 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:04.214993 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc514a7b-726f-4450-a22f-5f31f963a817 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:04.254612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c44608-447d-4f99-be71-e9d2f114a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:04.255239 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c44608-447d-4f99-be71-e9d2f114a053 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:04.255515 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c44608-447d-4f99-be71-e9d2f114a053 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:04.255790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c44608-447d-4f99-be71-e9d2f114a053 None admin] PATH_INFO: `/v3/domains/default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:04.257026 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c44608-447d-4f99-be71-e9d2f114a053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:04.258536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c44608-447d-4f99-be71-e9d2f114a053 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:04.260102 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 29/60] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:04.268813 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254af423-7b64-428f-a856-e5903580d48d None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:04.381609 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254af423-7b64-428f-a856-e5903580d48d None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:04.400752 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:04.420067 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171440-49df-48d0-b661-c30a2bf2f30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:04.420674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171440-49df-48d0-b661-c30a2bf2f30d None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:04.420951 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171440-49df-48d0-b661-c30a2bf2f30d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:04.421313 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171440-49df-48d0-b661-c30a2bf2f30d None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:04.421952 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25171440-49df-48d0-b661-c30a2bf2f30d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:04.423461 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25171440-49df-48d0-b661-c30a2bf2f30d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:04.452246 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 32/61] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:23:04 2022] POST /identity/v3/users => generated 275 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:23:08.000286 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143dda-ba9b-44ea-9e05-0267c36b7236 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.001354 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143dda-ba9b-44ea-9e05-0267c36b7236 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.001833 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143dda-ba9b-44ea-9e05-0267c36b7236 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.003534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 30/62] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:08.009548 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02546c-d5ad-47b5-a93b-19205eb5f1c3 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.010488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02546c-d5ad-47b5-a93b-19205eb5f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.010980 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02546c-d5ad-47b5-a93b-19205eb5f1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.034551 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-3c02546c-d5ad-47b5-a93b-19205eb5f1c3 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:08.036098 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-3c02546c-d5ad-47b5-a93b-19205eb5f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:08.137422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4213-8d4f-4a6a-99f7-bd15ba5cb3c4 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.138102 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4213-8d4f-4a6a-99f7-bd15ba5cb3c4 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.138481 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 33/63] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:08.138786 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4213-8d4f-4a6a-99f7-bd15ba5cb3c4 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.140411 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 31/64] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:08.156010 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101136-df65-42d4-aa49-69ae62ce8298 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.156311 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101136-df65-42d4-aa49-69ae62ce8298 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.156562 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101136-df65-42d4-aa49-69ae62ce8298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.180894 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-04101136-df65-42d4-aa49-69ae62ce8298 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:08.182119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-04101136-df65-42d4-aa49-69ae62ce8298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:08.276079 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 34/65] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:08.312950 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8983c1-c67d-49f4-a8f4-6ba74fa15c5e None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.313584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8983c1-c67d-49f4-a8f4-6ba74fa15c5e None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.314108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8983c1-c67d-49f4-a8f4-6ba74fa15c5e None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.315820 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 32/66] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:08.332357 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e14b-7f84-46d0-9f9d-a9371ac4a140 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.332671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e14b-7f84-46d0-9f9d-a9371ac4a140 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.332920 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e14b-7f84-46d0-9f9d-a9371ac4a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.358536 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-a364e14b-7f84-46d0-9f9d-a9371ac4a140 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:08.359778 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-a364e14b-7f84-46d0-9f9d-a9371ac4a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:08.400652 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:08.456348 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 35/67] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:08.513019 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3b3c2-6510-49c9-abda-b2ca6db35ad6 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.513019 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3b3c2-6510-49c9-abda-b2ca6db35ad6 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.513019 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3b3c2-6510-49c9-abda-b2ca6db35ad6 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.513019 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 33/68] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:08.518514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951a343-730d-48c7-93f2-94ea2dbffa9b None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.518802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951a343-730d-48c7-93f2-94ea2dbffa9b None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.519082 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951a343-730d-48c7-93f2-94ea2dbffa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.522681 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe509412-899e-4053-a696-0298a5031399 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.523274 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe509412-899e-4053-a696-0298a5031399 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.523763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe509412-899e-4053-a696-0298a5031399 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.525253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 34/69] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:08.529932 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda328a-c820-46d0-9abc-5d65ce626dd8 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.530528 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda328a-c820-46d0-9abc-5d65ce626dd8 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.531002 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda328a-c820-46d0-9abc-5d65ce626dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.540883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-c951a343-730d-48c7-93f2-94ea2dbffa9b None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:08.542691 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-c951a343-730d-48c7-93f2-94ea2dbffa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:08.544006 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:08.563007 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-4fda328a-c820-46d0-9abc-5d65ce626dd8 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:08.564216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-4fda328a-c820-46d0-9abc-5d65ce626dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:08.620846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 36/70] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:08.622044 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951a343-730d-48c7-93f2-94ea2dbffa9b None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:08.675460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 35/71] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:08.702836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda328a-c820-46d0-9abc-5d65ce626dd8 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:08.783740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:08.797205 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951a343-730d-48c7-93f2-94ea2dbffa9b None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:08.865382 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb3c8-f0fd-4e39-81e5-8be6675730d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:08.866060 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb3c8-f0fd-4e39-81e5-8be6675730d5 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.866339 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb3c8-f0fd-4e39-81e5-8be6675730d5 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.866606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb3c8-f0fd-4e39-81e5-8be6675730d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.876335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda328a-c820-46d0-9abc-5d65ce626dd8 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:08.879982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdb3c8-f0fd-4e39-81e5-8be6675730d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-dcbdb3c8-f0fd-4e39-81e5-8be6675730d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:08.885733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:08.886633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:08.887606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 37/72] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:08.888241 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb3c8-f0fd-4e39-81e5-8be6675730d5 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:08.918791 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696645c-0c56-43af-885f-6aa5d243c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:08.919670 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696645c-0c56-43af-885f-6aa5d243c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:08.920119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696645c-0c56-43af-885f-6aa5d243c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:08.920533 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696645c-0c56-43af-885f-6aa5d243c6d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:08.922805 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:08.933861 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696645c-0c56-43af-885f-6aa5d243c6d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-b696645c-0c56-43af-885f-6aa5d243c6d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:08.938923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:08.939967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:08.940916 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:08.942844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:23:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:23:08.943822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696645c-0c56-43af-885f-6aa5d243c6d1 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.014008 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb3c8-f0fd-4e39-81e5-8be6675730d5 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.048722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d428c-c58a-4352-aadc-bf8eefa16b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.049268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d428c-c58a-4352-aadc-bf8eefa16b5f None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.049545 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d428c-c58a-4352-aadc-bf8eefa16b5f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.049815 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d428c-c58a-4352-aadc-bf8eefa16b5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.050111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696645c-0c56-43af-885f-6aa5d243c6d1 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.059948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d428c-c58a-4352-aadc-bf8eefa16b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-c43d428c-c58a-4352-aadc-bf8eefa16b5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:09.064966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:09.065817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:09.066607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 38/74] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:23:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:09.067247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d428c-c58a-4352-aadc-bf8eefa16b5f None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.083038 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:09.090375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67060248-4fc5-4c1f-b7cf-31254a04a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.090991 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67060248-4fc5-4c1f-b7cf-31254a04a53e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.091421 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67060248-4fc5-4c1f-b7cf-31254a04a53e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.091699 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67060248-4fc5-4c1f-b7cf-31254a04a53e None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.092361 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67060248-4fc5-4c1f-b7cf-31254a04a53e None admin] RBAC: Adding query filter params (name=member) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:09.092871 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67060248-4fc5-4c1f-b7cf-31254a04a53e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:09.094091 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67060248-4fc5-4c1f-b7cf-31254a04a53e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:09.102221 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:09.107703 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67060248-4fc5-4c1f-b7cf-31254a04a53e None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.163891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:09.168502 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d428c-c58a-4352-aadc-bf8eefa16b5f None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.204910 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd3f8d-cc7b-43ae-aee6-9a658eeb4260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.206139 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd3f8d-cc7b-43ae-aee6-9a658eeb4260 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.206139 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd3f8d-cc7b-43ae-aee6-9a658eeb4260 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.206139 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd3f8d-cc7b-43ae-aee6-9a658eeb4260 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.206750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd3f8d-cc7b-43ae-aee6-9a658eeb4260 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:09.207071 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd3f8d-cc7b-43ae-aee6-9a658eeb4260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:09.208523 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd3f8d-cc7b-43ae-aee6-9a658eeb4260 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:09.214379 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67060248-4fc5-4c1f-b7cf-31254a04a53e None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.217204 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 39/76] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:09.218222 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd3f8d-cc7b-43ae-aee6-9a658eeb4260 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.254756 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066818b-27dd-4696-bb6d-67afb8c4c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.255403 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066818b-27dd-4696-bb6d-67afb8c4c7f6 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.255686 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066818b-27dd-4696-bb6d-67afb8c4c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.255960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066818b-27dd-4696-bb6d-67afb8c4c7f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.257122 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066818b-27dd-4696-bb6d-67afb8c4c7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:09.258719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066818b-27dd-4696-bb6d-67afb8c4c7f6 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:09.260542 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 38/77] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:09.261207 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066818b-27dd-4696-bb6d-67afb8c4c7f6 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.299990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:09.324346 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd3f8d-cc7b-43ae-aee6-9a658eeb4260 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.358951 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41595d1-c6c5-4b92-a7c5-2d4f2ea098e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.359344 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41595d1-c6c5-4b92-a7c5-2d4f2ea098e4 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.359623 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41595d1-c6c5-4b92-a7c5-2d4f2ea098e4 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.359904 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41595d1-c6c5-4b92-a7c5-2d4f2ea098e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.362079 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066818b-27dd-4696-bb6d-67afb8c4c7f6 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.370218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41595d1-c6c5-4b92-a7c5-2d4f2ea098e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-f41595d1-c6c5-4b92-a7c5-2d4f2ea098e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:09.375463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:09.376318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:09.377074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 40/78] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:09.377805 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41595d1-c6c5-4b92-a7c5-2d4f2ea098e4 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.389091 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:09.401894 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89e726-7207-4b33-a99f-e6beb5bd6bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.402538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89e726-7207-4b33-a99f-e6beb5bd6bf8 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.402825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89e726-7207-4b33-a99f-e6beb5bd6bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.403084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89e726-7207-4b33-a99f-e6beb5bd6bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.403740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89e726-7207-4b33-a99f-e6beb5bd6bf8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:09.404036 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89e726-7207-4b33-a99f-e6beb5bd6bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:09.405647 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89e726-7207-4b33-a99f-e6beb5bd6bf8 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:09.413579 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 39/79] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:23:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:09.414404 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89e726-7207-4b33-a99f-e6beb5bd6bf8 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.482852 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41595d1-c6c5-4b92-a7c5-2d4f2ea098e4 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.510836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89e726-7207-4b33-a99f-e6beb5bd6bf8 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.518016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90f9d6-d20b-4a93-8a28-41e56bff3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.518668 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f9d6-d20b-4a93-8a28-41e56bff3b2f None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.518948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f9d6-d20b-4a93-8a28-41e56bff3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.519224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f9d6-d20b-4a93-8a28-41e56bff3b2f None admin] PATH_INFO: `/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.522030 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:09.535540 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90f9d6-d20b-4a93-8a28-41e56bff3b2f None admin] RBAC: Authorizing `identity:get_user(user_id=34cb0c8fda3c4c3db8e786e2db0c16cc)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:09.537008 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90f9d6-d20b-4a93-8a28-41e56bff3b2f None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:09.538673 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 41/80] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:09 2022] GET /identity/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:09.542799 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90f9d6-d20b-4a93-8a28-41e56bff3b2f None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.545199 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3c6aa-edee-42ae-8a5a-5133b4b27576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.545844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3c6aa-edee-42ae-8a5a-5133b4b27576 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.546160 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3c6aa-edee-42ae-8a5a-5133b4b27576 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.546436 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3c6aa-edee-42ae-8a5a-5133b4b27576 None admin] PATH_INFO: `/v3/users/9d26dacccf744cb7a2a26549ace91be1` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.547619 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3c6aa-edee-42ae-8a5a-5133b4b27576 None admin] RBAC: Authorizing `identity:get_user(user_id=9d26dacccf744cb7a2a26549ace91be1)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:09.549084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3c6aa-edee-42ae-8a5a-5133b4b27576 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:09.550770 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 40/81] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:09 2022] GET /identity/v3/users/9d26dacccf744cb7a2a26549ace91be1 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:09.551473 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3c6aa-edee-42ae-8a5a-5133b4b27576 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.611360 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:09.656601 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90f9d6-d20b-4a93-8a28-41e56bff3b2f None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.660652 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3c6aa-edee-42ae-8a5a-5133b4b27576 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.695441 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e969143-5c4b-4ece-b3ea-fec6f88b6491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.696185 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969143-5c4b-4ece-b3ea-fec6f88b6491 None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.696461 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969143-5c4b-4ece-b3ea-fec6f88b6491 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.696731 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969143-5c4b-4ece-b3ea-fec6f88b6491 None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.696973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6441f9-3f39-48f0-8207-6cc5adfc3a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.697363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e969143-5c4b-4ece-b3ea-fec6f88b6491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:09.697588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6441f9-3f39-48f0-8207-6cc5adfc3a56 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.697868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6441f9-3f39-48f0-8207-6cc5adfc3a56 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.698179 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6441f9-3f39-48f0-8207-6cc5adfc3a56 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.698873 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e969143-5c4b-4ece-b3ea-fec6f88b6491 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:09.698984 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6441f9-3f39-48f0-8207-6cc5adfc3a56 None admin] RBAC: Adding query filter params (name=member) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:09.699180 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6441f9-3f39-48f0-8207-6cc5adfc3a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:09.700557 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6441f9-3f39-48f0-8207-6cc5adfc3a56 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:09.709122 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 41/82] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:09.709670 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6441f9-3f39-48f0-8207-6cc5adfc3a56 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.722300 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 42/83] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:23:09 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:23:09.723197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e969143-5c4b-4ece-b3ea-fec6f88b6491 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.779626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:09.837459 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6441f9-3f39-48f0-8207-6cc5adfc3a56 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.846081 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e969143-5c4b-4ece-b3ea-fec6f88b6491 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:09.857171 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:09.878128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbb4dd-efb4-4d55-9b6e-6f5b784c9076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.878780 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbb4dd-efb4-4d55-9b6e-6f5b784c9076 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.879066 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbb4dd-efb4-4d55-9b6e-6f5b784c9076 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.879354 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbb4dd-efb4-4d55-9b6e-6f5b784c9076 None admin] PATH_INFO: `/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.880579 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbb4dd-efb4-4d55-9b6e-6f5b784c9076 None admin] RBAC: Authorizing `identity:get_user(user_id=34cb0c8fda3c4c3db8e786e2db0c16cc)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:09.882195 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbb4dd-efb4-4d55-9b6e-6f5b784c9076 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:09.884230 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 42/84] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:09 2022] GET /identity/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:09.884888 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbb4dd-efb4-4d55-9b6e-6f5b784c9076 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:09.886934 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddf1a0-0666-41c1-87e6-e3151b3e12af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:09.887965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf1a0-0666-41c1-87e6-e3151b3e12af None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:09.888273 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf1a0-0666-41c1-87e6-e3151b3e12af None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:09.888550 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf1a0-0666-41c1-87e6-e3151b3e12af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:09.975489 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddf1a0-0666-41c1-87e6-e3151b3e12af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:09.976960 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddf1a0-0666-41c1-87e6-e3151b3e12af None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:10.015295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbb4dd-efb4-4d55-9b6e-6f5b784c9076 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:10.040813 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:10.067529 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6e619-2ddc-4eb7-9c34-f0a528c730a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:10.068180 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6e619-2ddc-4eb7-9c34-f0a528c730a8 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:10.068447 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6e619-2ddc-4eb7-9c34-f0a528c730a8 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:10.068717 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6e619-2ddc-4eb7-9c34-f0a528c730a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:10.112219 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 43/85] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:10.113166 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddf1a0-0666-41c1-87e6-e3151b3e12af None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:10.149035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:10.168071 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6e619-2ddc-4eb7-9c34-f0a528c730a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:10.169643 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6e619-2ddc-4eb7-9c34-f0a528c730a8 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:10.261978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddf1a0-0666-41c1-87e6-e3151b3e12af None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:10.287668 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 43/86] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:10.288853 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6e619-2ddc-4eb7-9c34-f0a528c730a8 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:10.313911 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9a200-6081-4eb1-af6f-7c6132943d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:10.314686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a200-6081-4eb1-af6f-7c6132943d09 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:10.315456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a200-6081-4eb1-af6f-7c6132943d09 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:10.315748 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a200-6081-4eb1-af6f-7c6132943d09 None admin] PATH_INFO: `/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:10.317174 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9a200-6081-4eb1-af6f-7c6132943d09 None admin] RBAC: Authorizing `identity:get_user(user_id=34cb0c8fda3c4c3db8e786e2db0c16cc)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:10.318949 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9a200-6081-4eb1-af6f-7c6132943d09 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:10.321339 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 44/87] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:10 2022] GET /identity/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:10.322493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9a200-6081-4eb1-af6f-7c6132943d09 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:10.344852 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:10.405375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:10.424563 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6e619-2ddc-4eb7-9c34-f0a528c730a8 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:10.432140 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9a200-6081-4eb1-af6f-7c6132943d09 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:10.467976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f8068-5fb5-4174-941c-88a4ab7c55f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:10.468855 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8068-5fb5-4174-941c-88a4ab7c55f6 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:10.469198 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8068-5fb5-4174-941c-88a4ab7c55f6 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:10.469534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8068-5fb5-4174-941c-88a4ab7c55f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:10.469920 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b2dc8-f403-4674-854e-6654c448529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:10.470908 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2dc8-f403-4674-854e-6654c448529a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:10.471362 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2dc8-f403-4674-854e-6654c448529a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:10.471817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2dc8-f403-4674-854e-6654c448529a None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:10.473123 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b2dc8-f403-4674-854e-6654c448529a None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:10.474818 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b2dc8-f403-4674-854e-6654c448529a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:10.476693 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 45/88] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:10 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:10.477662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b2dc8-f403-4674-854e-6654c448529a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:10.562392 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f8068-5fb5-4174-941c-88a4ab7c55f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:10.564204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f8068-5fb5-4174-941c-88a4ab7c55f6 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:10.578365 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:10.582982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b2dc8-f403-4674-854e-6654c448529a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:10.621125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96680b78-52f4-4e6f-a8f5-de4570925bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:10.622299 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680b78-52f4-4e6f-a8f5-de4570925bf8 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:10.622863 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680b78-52f4-4e6f-a8f5-de4570925bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:10.623329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680b78-52f4-4e6f-a8f5-de4570925bf8 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:10.624698 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96680b78-52f4-4e6f-a8f5-de4570925bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:10.626601 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96680b78-52f4-4e6f-a8f5-de4570925bf8 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:10.628888 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 46/89] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:10 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:10.629966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96680b78-52f4-4e6f-a8f5-de4570925bf8 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:10.667900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:10.687742 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 44/90] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:10.689064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f8068-5fb5-4174-941c-88a4ab7c55f6 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:10.748626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96680b78-52f4-4e6f-a8f5-de4570925bf8 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:10.790464 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a657-c151-40f2-ba6a-28bc81827aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:10.791080 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a657-c151-40f2-ba6a-28bc81827aa4 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:10.791695 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a657-c151-40f2-ba6a-28bc81827aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:10.791960 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a657-c151-40f2-ba6a-28bc81827aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:10.799311 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f8068-5fb5-4174-941c-88a4ab7c55f6 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:10.821226 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:10.840880 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4262ac2-a2a6-428b-81ee-34dab86d6bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:10.842019 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4262ac2-a2a6-428b-81ee-34dab86d6bbe None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:10.847138 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4262ac2-a2a6-428b-81ee-34dab86d6bbe None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:10.847750 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4262ac2-a2a6-428b-81ee-34dab86d6bbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:10.848797 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4262ac2-a2a6-428b-81ee-34dab86d6bbe None admin] RBAC: Adding query filter params (role.id=848a48b503dc483fbbc428affa473937, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79, user.id=34cb0c8fda3c4c3db8e786e2db0c16cc) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:10.849329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4262ac2-a2a6-428b-81ee-34dab86d6bbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:10.851070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4262ac2-a2a6-428b-81ee-34dab86d6bbe None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:10.857980 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 45/91] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:10 2022] GET /identity/v3/role_assignments?user.id=34cb0c8fda3c4c3db8e786e2db0c16cc&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=848a48b503dc483fbbc428affa473937 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:10.859077 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4262ac2-a2a6-428b-81ee-34dab86d6bbe None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:10.888279 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7a657-c151-40f2-ba6a-28bc81827aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:10.890340 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7a657-c151-40f2-ba6a-28bc81827aa4 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:10.968384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:11.051835 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4262ac2-a2a6-428b-81ee-34dab86d6bbe None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:11.069794 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 47/92] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:11.070974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a657-c151-40f2-ba6a-28bc81827aa4 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:11.091723 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a991f96-934f-4f95-8139-d1781b571f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:11.092388 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a991f96-934f-4f95-8139-d1781b571f49 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:11.092705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a991f96-934f-4f95-8139-d1781b571f49 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:11.092989 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a991f96-934f-4f95-8139-d1781b571f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:11.093798 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a991f96-934f-4f95-8139-d1781b571f49 None admin] RBAC: Adding query filter params (role.id=4ef4b944934e44a28a394ebd1a816f64, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79, user.id=9d26dacccf744cb7a2a26549ace91be1) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:11.094151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a991f96-934f-4f95-8139-d1781b571f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:11.095634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a991f96-934f-4f95-8139-d1781b571f49 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:11.102262 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 46/93] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:10 2022] GET /identity/v3/role_assignments?user.id=9d26dacccf744cb7a2a26549ace91be1&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:11.110022 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a991f96-934f-4f95-8139-d1781b571f49 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:11.161828 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:11.250067 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a657-c151-40f2-ba6a-28bc81827aa4 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:11.300770 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c82c78-0e05-430e-950b-0a52cd0469d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:11.301427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c82c78-0e05-430e-950b-0a52cd0469d5 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:11.301702 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c82c78-0e05-430e-950b-0a52cd0469d5 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:11.301971 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c82c78-0e05-430e-950b-0a52cd0469d5 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:11.302318 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a991f96-934f-4f95-8139-d1781b571f49 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:11.303253 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c82c78-0e05-430e-950b-0a52cd0469d5 None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:11.304724 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c82c78-0e05-430e-950b-0a52cd0469d5 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:11.307516 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 48/94] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:11 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:11.313534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c82c78-0e05-430e-950b-0a52cd0469d5 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:11.325175 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:11.380837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f8387-64d9-4748-b40e-3416d95b5ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:11.381544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8387-64d9-4748-b40e-3416d95b5ab9 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:11.381832 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8387-64d9-4748-b40e-3416d95b5ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:11.382135 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8387-64d9-4748-b40e-3416d95b5ab9 None admin] PATH_INFO: `/v3/projects/0ea7d0269f09447999f1d16f4e39478b` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:11.386862 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f8387-64d9-4748-b40e-3416d95b5ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=0ea7d0269f09447999f1d16f4e39478b)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:11.388456 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f8387-64d9-4748-b40e-3416d95b5ab9 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:11.390632 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 47/95] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:11 2022] GET /identity/v3/projects/0ea7d0269f09447999f1d16f4e39478b => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:11.396368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f8387-64d9-4748-b40e-3416d95b5ab9 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:11.432954 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c82c78-0e05-430e-950b-0a52cd0469d5 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:11.465659 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:11.482021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830b4a0-6137-4ef3-976e-7f81fba94906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:11.482021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b4a0-6137-4ef3-976e-7f81fba94906 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:11.482021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b4a0-6137-4ef3-976e-7f81fba94906 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:11.482021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b4a0-6137-4ef3-976e-7f81fba94906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:11.482441 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830b4a0-6137-4ef3-976e-7f81fba94906 None admin] RBAC: Adding query filter params (role.id=cee2b2731e93403d9f425e05f6905b53, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79, user.id=34cb0c8fda3c4c3db8e786e2db0c16cc) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:11.482441 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830b4a0-6137-4ef3-976e-7f81fba94906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:11.482807 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830b4a0-6137-4ef3-976e-7f81fba94906 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:11.490201 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 49/96] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:11 2022] GET /identity/v3/role_assignments?user.id=34cb0c8fda3c4c3db8e786e2db0c16cc&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=cee2b2731e93403d9f425e05f6905b53 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:11.566710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f8387-64d9-4748-b40e-3416d95b5ab9 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:11.626697 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a876243-f954-42a5-8b09-90e9c0b4e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:11.627342 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876243-f954-42a5-8b09-90e9c0b4e19c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:11.627624 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876243-f954-42a5-8b09-90e9c0b4e19c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:11.627898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876243-f954-42a5-8b09-90e9c0b4e19c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:11.628639 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876243-f954-42a5-8b09-90e9c0b4e19c None admin] RBAC: Adding query filter params (role.id=848a48b503dc483fbbc428affa473937, scope.project.id=0ea7d0269f09447999f1d16f4e39478b, user.id=34cb0c8fda3c4c3db8e786e2db0c16cc) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:11.628949 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876243-f954-42a5-8b09-90e9c0b4e19c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:11.630546 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876243-f954-42a5-8b09-90e9c0b4e19c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:11.637022 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 48/97] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:11 2022] GET /identity/v3/role_assignments?user.id=34cb0c8fda3c4c3db8e786e2db0c16cc&scope.project.id=0ea7d0269f09447999f1d16f4e39478b&role.id=848a48b503dc483fbbc428affa473937 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:12.397934 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564627-d81d-4488-a5b3-16bbd5561b56 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:12.398525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564627-d81d-4488-a5b3-16bbd5561b56 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:12.398525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564627-d81d-4488-a5b3-16bbd5561b56 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:12.399982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 50/98] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:12.405736 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c2bd-0cf5-4b86-903c-72cad1171778 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:12.406664 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c2bd-0cf5-4b86-903c-72cad1171778 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:12.407128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c2bd-0cf5-4b86-903c-72cad1171778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:12.434242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-e1a7c2bd-0cf5-4b86-903c-72cad1171778 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:12.435836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-e1a7c2bd-0cf5-4b86-903c-72cad1171778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:12.441104 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c3af-7aad-45f9-8fbb-e12b39375e07 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:12.441619 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c3af-7aad-45f9-8fbb-e12b39375e07 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:12.442106 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c3af-7aad-45f9-8fbb-e12b39375e07 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:12.443611 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 51/99] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:12.449158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf55f4-b295-4449-9898-cbcf5b95086d None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:12.449707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf55f4-b295-4449-9898-cbcf5b95086d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:12.450199 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf55f4-b295-4449-9898-cbcf5b95086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:12.470823 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-1dcf55f4-b295-4449-9898-cbcf5b95086d None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:12.472462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-1dcf55f4-b295-4449-9898-cbcf5b95086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:12.502488 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:12.536278 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 49/100] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:12.592671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 52/101] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:13.150872 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7c2bd-0cf5-4b86-903c-72cad1171778 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:13.272251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf55f4-b295-4449-9898-cbcf5b95086d None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:13.297887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7c2bd-0cf5-4b86-903c-72cad1171778 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:13.348608 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259940fd-cee0-46ee-acdc-981775a726c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:13.349638 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259940fd-cee0-46ee-acdc-981775a726c5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:13.350173 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259940fd-cee0-46ee-acdc-981775a726c5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:13.350640 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259940fd-cee0-46ee-acdc-981775a726c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:13.352098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259940fd-cee0-46ee-acdc-981775a726c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:13.353786 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259940fd-cee0-46ee-acdc-981775a726c5 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:13.355627 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 50/102] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:13.373778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259940fd-cee0-46ee-acdc-981775a726c5 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:13.415028 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf55f4-b295-4449-9898-cbcf5b95086d None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:13.434445 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:13.437245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:13.455432 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7337cc-70f7-434f-9ab1-02ab15a3ac2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:13.456084 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7337cc-70f7-434f-9ab1-02ab15a3ac2c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:13.456358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7337cc-70f7-434f-9ab1-02ab15a3ac2c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:13.456625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7337cc-70f7-434f-9ab1-02ab15a3ac2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:13.468245 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7337cc-70f7-434f-9ab1-02ab15a3ac2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-1e7337cc-70f7-434f-9ab1-02ab15a3ac2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:13.473085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:13.473945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:13.474760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 53/103] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:23:13.480117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7337cc-70f7-434f-9ab1-02ab15a3ac2c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:13.506114 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259940fd-cee0-46ee-acdc-981775a726c5 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:13.542454 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d52fec-7371-41c2-9985-1722b1a0a99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:13.543437 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d52fec-7371-41c2-9985-1722b1a0a99d None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:13.543914 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d52fec-7371-41c2-9985-1722b1a0a99d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:13.544378 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d52fec-7371-41c2-9985-1722b1a0a99d None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:13.545421 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d52fec-7371-41c2-9985-1722b1a0a99d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:13.547420 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d52fec-7371-41c2-9985-1722b1a0a99d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:13.579179 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 51/104] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 19:23:13 2022] POST /identity/v3/projects => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:23:13.589410 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7337cc-70f7-434f-9ab1-02ab15a3ac2c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:13.639842 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85f45e-0eb1-40d8-8b08-25461bce607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:13.640466 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85f45e-0eb1-40d8-8b08-25461bce607c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:13.640741 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85f45e-0eb1-40d8-8b08-25461bce607c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:13.641014 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85f45e-0eb1-40d8-8b08-25461bce607c None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:13.641690 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85f45e-0eb1-40d8-8b08-25461bce607c None admin] RBAC: Adding query filter params (name=reader) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:13.642015 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85f45e-0eb1-40d8-8b08-25461bce607c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:13.643462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85f45e-0eb1-40d8-8b08-25461bce607c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:13.652828 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 54/105] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:13.658973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d52fec-7371-41c2-9985-1722b1a0a99d None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:13.806710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:13.815194 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d52fec-7371-41c2-9985-1722b1a0a99d None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:13.852715 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cbe7e-b0b1-446f-bbd7-8012833d1795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:13.853740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cbe7e-b0b1-446f-bbd7-8012833d1795 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:13.854238 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cbe7e-b0b1-446f-bbd7-8012833d1795 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:13.854684 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cbe7e-b0b1-446f-bbd7-8012833d1795 None admin] PATH_INFO: `/v3/users/d14ee78c11714801ac375212753b4676` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:13.869957 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cbe7e-b0b1-446f-bbd7-8012833d1795 None admin] RBAC: Authorizing `identity:get_user(user_id=d14ee78c11714801ac375212753b4676)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:13.871730 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cbe7e-b0b1-446f-bbd7-8012833d1795 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:13.873588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 52/106] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:13 2022] GET /identity/v3/users/d14ee78c11714801ac375212753b4676 => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:13.879368 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85f45e-0eb1-40d8-8b08-25461bce607c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:13.935922 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:14.002376 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85f45e-0eb1-40d8-8b08-25461bce607c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:14.050747 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf1ea1-cbef-41db-8281-1386939134d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:14.051478 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf1ea1-cbef-41db-8281-1386939134d3 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:14.051766 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf1ea1-cbef-41db-8281-1386939134d3 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:14.052045 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf1ea1-cbef-41db-8281-1386939134d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:14.111834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e140-54a0-4b54-8a25-22031aa6de7f None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:14.112132 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e140-54a0-4b54-8a25-22031aa6de7f None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:14.112312 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e140-54a0-4b54-8a25-22031aa6de7f None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:14.113671 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 53/107] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:14.120961 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc2aa-9c6a-467b-a119-9179ed499147 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:14.121250 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc2aa-9c6a-467b-a119-9179ed499147 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:14.121532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc2aa-9c6a-467b-a119-9179ed499147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:14.151411 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-955dc2aa-9c6a-467b-a119-9179ed499147 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:14.152636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-955dc2aa-9c6a-467b-a119-9179ed499147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:14.169315 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf1ea1-cbef-41db-8281-1386939134d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:14.171402 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf1ea1-cbef-41db-8281-1386939134d3 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:14.259625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:14.309243 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 54/108] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:14.366111 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 55/109] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:14.371847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dc2aa-9c6a-467b-a119-9179ed499147 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:14.497844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:14.522677 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dc2aa-9c6a-467b-a119-9179ed499147 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:14.575576 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c55d-9960-41dd-8c59-b9932ab76949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:14.576228 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c55d-9960-41dd-8c59-b9932ab76949 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:14.576525 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c55d-9960-41dd-8c59-b9932ab76949 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:14.576787 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c55d-9960-41dd-8c59-b9932ab76949 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:14.578071 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1c55d-9960-41dd-8c59-b9932ab76949 None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:14.579637 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1c55d-9960-41dd-8c59-b9932ab76949 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:14.581613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 55/110] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:14 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:14.587675 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf1ea1-cbef-41db-8281-1386939134d3 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:14.717735 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf1ea1-cbef-41db-8281-1386939134d3 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:14.760936 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9aa56-3400-408e-83e2-7d4fdc665866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:14.761548 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9aa56-3400-408e-83e2-7d4fdc665866 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:14.761828 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9aa56-3400-408e-83e2-7d4fdc665866 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:14.762126 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9aa56-3400-408e-83e2-7d4fdc665866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:14.762856 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9aa56-3400-408e-83e2-7d4fdc665866 None admin] RBAC: Adding query filter params (role.id=eb7fb540254848549730933af8f59dcb, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79, user.id=d14ee78c11714801ac375212753b4676) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:14.763163 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9aa56-3400-408e-83e2-7d4fdc665866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:14.764641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9aa56-3400-408e-83e2-7d4fdc665866 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:14.772390 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 56/111] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:14 2022] GET /identity/v3/role_assignments?user.id=d14ee78c11714801ac375212753b4676&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=eb7fb540254848549730933af8f59dcb => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:14.953676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c55d-9960-41dd-8c59-b9932ab76949 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:15.090493 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c55d-9960-41dd-8c59-b9932ab76949 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:15.136212 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fa3e3-7a99-41b7-bafc-77c06ed8968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:15.137234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa3e3-7a99-41b7-bafc-77c06ed8968c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:15.137789 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa3e3-7a99-41b7-bafc-77c06ed8968c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:15.138360 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa3e3-7a99-41b7-bafc-77c06ed8968c None admin] PATH_INFO: `/v3/roles/member` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:15.154605 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fa3e3-7a99-41b7-bafc-77c06ed8968c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-1d1fa3e3-7a99-41b7-bafc-77c06ed8968c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:15.160532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:15.161976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:15.163285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:15.171070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 56/112] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:15.179237 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9aa56-3400-408e-83e2-7d4fdc665866 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:15.182752 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:15.208719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412189f-0107-40ca-9c0d-61873985f667 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:15.209346 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412189f-0107-40ca-9c0d-61873985f667 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:15.209817 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412189f-0107-40ca-9c0d-61873985f667 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:15.212556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 57/113] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:15.219786 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f58efc-583e-4b1e-90db-4637d9948ecf None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:15.220382 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f58efc-583e-4b1e-90db-4637d9948ecf None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:15.220910 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f58efc-583e-4b1e-90db-4637d9948ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:15.258528 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-80f58efc-583e-4b1e-90db-4637d9948ecf None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:15.260096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-80f58efc-583e-4b1e-90db-4637d9948ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:15.263496 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:15.377891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9aa56-3400-408e-83e2-7d4fdc665866 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:15.406145 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 58/114] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:15.408527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add48e2-dd44-432f-92d3-cfedf368073d None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:15.408816 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add48e2-dd44-432f-92d3-cfedf368073d None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:15.409808 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add48e2-dd44-432f-92d3-cfedf368073d None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:15.411125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 59/115] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:15.417941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35cca-0776-4df9-a1aa-b4be01b097ae None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:15.418247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35cca-0776-4df9-a1aa-b4be01b097ae None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:15.418521 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35cca-0776-4df9-a1aa-b4be01b097ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:15.429641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439ebbe-a384-4ce5-982b-8fae7cfefc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:15.430284 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439ebbe-a384-4ce5-982b-8fae7cfefc8b None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:15.430605 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439ebbe-a384-4ce5-982b-8fae7cfefc8b None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:15.430878 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439ebbe-a384-4ce5-982b-8fae7cfefc8b None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:15.431547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439ebbe-a384-4ce5-982b-8fae7cfefc8b None admin] RBAC: Adding query filter params (name=member) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:15.431846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439ebbe-a384-4ce5-982b-8fae7cfefc8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:15.433238 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439ebbe-a384-4ce5-982b-8fae7cfefc8b None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:15.448862 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 57/116] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:15.455452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e149354-82ef-41a9-8c6a-e0dd4938478d None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:15.455740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e149354-82ef-41a9-8c6a-e0dd4938478d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:15.456021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e149354-82ef-41a9-8c6a-e0dd4938478d None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:15.457256 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 58/117] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:15.458340 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e149354-82ef-41a9-8c6a-e0dd4938478d None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:15.458517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-34f35cca-0776-4df9-a1aa-b4be01b097ae None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:15.459911 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-34f35cca-0776-4df9-a1aa-b4be01b097ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:15.574711 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:15.607308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 60/118] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:15.610121 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f87a0-ad13-424f-8648-5bc6de370afe None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:15.610419 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f87a0-ad13-424f-8648-5bc6de370afe None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:15.610697 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f87a0-ad13-424f-8648-5bc6de370afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:15.641316 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e149354-82ef-41a9-8c6a-e0dd4938478d None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:15.647875 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-641f87a0-ad13-424f-8648-5bc6de370afe None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:15.653143 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-641f87a0-ad13-424f-8648-5bc6de370afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:15.721198 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821a0e1-e19e-416d-bb2e-424c70a4652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:15.721855 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821a0e1-e19e-416d-bb2e-424c70a4652b None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:15.722159 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821a0e1-e19e-416d-bb2e-424c70a4652b None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:15.722432 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821a0e1-e19e-416d-bb2e-424c70a4652b None admin] PATH_INFO: `/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:15.725375 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821a0e1-e19e-416d-bb2e-424c70a4652b None admin] RBAC: Authorizing `identity:get_user(user_id=34cb0c8fda3c4c3db8e786e2db0c16cc)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:15.726866 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821a0e1-e19e-416d-bb2e-424c70a4652b None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:15.728547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 59/119] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:15 2022] GET /identity/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:15.735422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821a0e1-e19e-416d-bb2e-424c70a4652b None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:15.795246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:15.817464 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 61/120] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:15.818402 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f87a0-ad13-424f-8648-5bc6de370afe None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:15.926747 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821a0e1-e19e-416d-bb2e-424c70a4652b None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:15.972404 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f87a0-ad13-424f-8648-5bc6de370afe None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:15.984910 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:15.999823 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759addc-dd39-4c07-ae4b-720ff9fce88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:16.000822 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759addc-dd39-4c07-ae4b-720ff9fce88d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.001297 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759addc-dd39-4c07-ae4b-720ff9fce88d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.001764 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759addc-dd39-4c07-ae4b-720ff9fce88d None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.003149 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759addc-dd39-4c07-ae4b-720ff9fce88d None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:16.004884 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759addc-dd39-4c07-ae4b-720ff9fce88d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:16.006931 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 60/121] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:15 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:16.018350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36367195-be7a-4338-9006-4be19e79c1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:16.019012 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36367195-be7a-4338-9006-4be19e79c1f2 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.019299 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36367195-be7a-4338-9006-4be19e79c1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.019575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36367195-be7a-4338-9006-4be19e79c1f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.021252 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759addc-dd39-4c07-ae4b-720ff9fce88d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:16.038019 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36367195-be7a-4338-9006-4be19e79c1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-36367195-be7a-4338-9006-4be19e79c1f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:16.041020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:16.042281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:16.043063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:16.050781 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 62/122] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:23:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:16.059344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36367195-be7a-4338-9006-4be19e79c1f2 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:16.137714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:16.210376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36367195-be7a-4338-9006-4be19e79c1f2 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:16.255519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9886056-f3ea-42a6-9755-e4ba1485feb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:16.256154 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886056-f3ea-42a6-9755-e4ba1485feb9 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.256432 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886056-f3ea-42a6-9755-e4ba1485feb9 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.256926 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886056-f3ea-42a6-9755-e4ba1485feb9 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.257617 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9886056-f3ea-42a6-9755-e4ba1485feb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:16.257920 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9886056-f3ea-42a6-9755-e4ba1485feb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:16.259372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9886056-f3ea-42a6-9755-e4ba1485feb9 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:16.272135 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 63/123] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:16.273042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9886056-f3ea-42a6-9755-e4ba1485feb9 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:16.274649 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759addc-dd39-4c07-ae4b-720ff9fce88d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:16.351621 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495589c5-d855-4381-8b10-049f25c30571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:16.352885 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495589c5-d855-4381-8b10-049f25c30571 None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.353166 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495589c5-d855-4381-8b10-049f25c30571 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.353708 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495589c5-d855-4381-8b10-049f25c30571 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/users/34cb0c8fda3c4c3db8e786e2db0c16cc/roles/848a48b503dc483fbbc428affa473937` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.356926 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495589c5-d855-4381-8b10-049f25c30571 None admin] RBAC: Authorizing `identity:create_grant(project_id=84253ede8aa34d9bb8638223c2d7ad79, user_id=34cb0c8fda3c4c3db8e786e2db0c16cc, role_id=848a48b503dc483fbbc428affa473937)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:16.358517 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495589c5-d855-4381-8b10-049f25c30571 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:16.378032 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 61/124] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:23:16 2022] PUT /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/users/34cb0c8fda3c4c3db8e786e2db0c16cc/roles/848a48b503dc483fbbc428affa473937 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:23:16.378032 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495589c5-d855-4381-8b10-049f25c30571 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:16.392588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9886056-f3ea-42a6-9755-e4ba1485feb9 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:16.425803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:16.447955 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685129-d430-4fc0-85d8-c08930ed3e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:16.449101 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685129-d430-4fc0-85d8-c08930ed3e33 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.449469 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685129-d430-4fc0-85d8-c08930ed3e33 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.449837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685129-d430-4fc0-85d8-c08930ed3e33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.466568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685129-d430-4fc0-85d8-c08930ed3e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-50685129-d430-4fc0-85d8-c08930ed3e33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:16.474376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:16.475512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:16.476316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:16.477370 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:16.477517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 64/125] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:23:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:16.477642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685129-d430-4fc0-85d8-c08930ed3e33 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:16.532277 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495589c5-d855-4381-8b10-049f25c30571 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:16.577880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d389a-4f8c-471b-96a2-484dbd0d3b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:16.578570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d389a-4f8c-471b-96a2-484dbd0d3b40 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.578852 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d389a-4f8c-471b-96a2-484dbd0d3b40 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.579126 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d389a-4f8c-471b-96a2-484dbd0d3b40 None admin] PATH_INFO: `/v3/users/9d26dacccf744cb7a2a26549ace91be1` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.582446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d389a-4f8c-471b-96a2-484dbd0d3b40 None admin] RBAC: Authorizing `identity:get_user(user_id=9d26dacccf744cb7a2a26549ace91be1)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:16.584173 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d389a-4f8c-471b-96a2-484dbd0d3b40 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:16.587180 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 62/126] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:16 2022] GET /identity/v3/users/9d26dacccf744cb7a2a26549ace91be1 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:16.588717 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d330bf-964c-40a3-b795-d7acaefcfaec None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.588842 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d330bf-964c-40a3-b795-d7acaefcfaec None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.589110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d330bf-964c-40a3-b795-d7acaefcfaec None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.590456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 63/127] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:16.591189 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d330bf-964c-40a3-b795-d7acaefcfaec None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:16.625398 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685129-d430-4fc0-85d8-c08930ed3e33 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:16.674930 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e1438-daca-4568-b4a3-0cd6a9149545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:16.676603 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1438-daca-4568-b4a3-0cd6a9149545 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.677103 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1438-daca-4568-b4a3-0cd6a9149545 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.677591 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1438-daca-4568-b4a3-0cd6a9149545 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.694543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e1438-daca-4568-b4a3-0cd6a9149545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-296e1438-daca-4568-b4a3-0cd6a9149545 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:16.703410 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:16.704287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:16.705076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 65/128] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:16.706267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e1438-daca-4568-b4a3-0cd6a9149545 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:16.732125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d330bf-964c-40a3-b795-d7acaefcfaec None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:16.763555 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:16.766969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:16.774761 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31b5f3-fc84-4f6a-8af2-5a615772c9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:16.775692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31b5f3-fc84-4f6a-8af2-5a615772c9d1 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.776144 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31b5f3-fc84-4f6a-8af2-5a615772c9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.776647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31b5f3-fc84-4f6a-8af2-5a615772c9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.777548 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31b5f3-fc84-4f6a-8af2-5a615772c9d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:16.778082 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31b5f3-fc84-4f6a-8af2-5a615772c9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:16.779817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31b5f3-fc84-4f6a-8af2-5a615772c9d1 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:16.792430 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 64/129] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:23:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:16.794259 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b7b2-d1d0-4b50-8f20-e5193a352e80 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.794854 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b7b2-d1d0-4b50-8f20-e5193a352e80 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.795328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b7b2-d1d0-4b50-8f20-e5193a352e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.815980 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-7535b7b2-d1d0-4b50-8f20-e5193a352e80 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:16.818088 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-7535b7b2-d1d0-4b50-8f20-e5193a352e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:16.838817 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e1438-daca-4568-b4a3-0cd6a9149545 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:16.886049 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662fbc0-3718-4894-916f-53b606a8ad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:16.886993 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662fbc0-3718-4894-916f-53b606a8ad8a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.887283 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662fbc0-3718-4894-916f-53b606a8ad8a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.887559 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662fbc0-3718-4894-916f-53b606a8ad8a None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.888895 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662fbc0-3718-4894-916f-53b606a8ad8a None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:16.891263 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662fbc0-3718-4894-916f-53b606a8ad8a None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:16.892964 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 66/130] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:16 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:16.898146 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662fbc0-3718-4894-916f-53b606a8ad8a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:16.923761 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 65/131] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:16.925517 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535b7b2-d1d0-4b50-8f20-e5193a352e80 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:17.038169 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535b7b2-d1d0-4b50-8f20-e5193a352e80 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:17.067380 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:17.078119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662fbc0-3718-4894-916f-53b606a8ad8a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:17.080987 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ce3fa-dcee-43c6-a1af-0588bbc54431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:17.082223 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce3fa-dcee-43c6-a1af-0588bbc54431 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:17.082919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce3fa-dcee-43c6-a1af-0588bbc54431 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:17.083554 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce3fa-dcee-43c6-a1af-0588bbc54431 None admin] PATH_INFO: `/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:17.085545 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ce3fa-dcee-43c6-a1af-0588bbc54431 None admin] RBAC: Authorizing `identity:get_user(user_id=34cb0c8fda3c4c3db8e786e2db0c16cc)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:17.088255 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ce3fa-dcee-43c6-a1af-0588bbc54431 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:17.090127 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 66/132] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:16 2022] GET /identity/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:17.091350 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ce3fa-dcee-43c6-a1af-0588bbc54431 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:17.108741 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:17.163526 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d143013-9ebe-48ca-b725-faed45da325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:17.164029 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d143013-9ebe-48ca-b725-faed45da325a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:17.164318 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d143013-9ebe-48ca-b725-faed45da325a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:17.164598 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d143013-9ebe-48ca-b725-faed45da325a None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:17.165284 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d143013-9ebe-48ca-b725-faed45da325a None admin] RBAC: Adding query filter params (name=member) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:17.165570 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d143013-9ebe-48ca-b725-faed45da325a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:17.167497 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d143013-9ebe-48ca-b725-faed45da325a None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:17.188540 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 67/133] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:17.190529 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d143013-9ebe-48ca-b725-faed45da325a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:17.225661 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ce3fa-dcee-43c6-a1af-0588bbc54431 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:17.269716 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5853763-8c37-44ea-b0a7-6f90e63e300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:17.270896 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853763-8c37-44ea-b0a7-6f90e63e300e None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:17.271409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853763-8c37-44ea-b0a7-6f90e63e300e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:17.271872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853763-8c37-44ea-b0a7-6f90e63e300e None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/users/9d26dacccf744cb7a2a26549ace91be1/roles/4ef4b944934e44a28a394ebd1a816f64` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:17.274546 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5853763-8c37-44ea-b0a7-6f90e63e300e None admin] RBAC: Authorizing `identity:create_grant(project_id=84253ede8aa34d9bb8638223c2d7ad79, user_id=9d26dacccf744cb7a2a26549ace91be1, role_id=4ef4b944934e44a28a394ebd1a816f64)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:17.276588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5853763-8c37-44ea-b0a7-6f90e63e300e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:17.294240 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 67/134] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:23:17 2022] PUT /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/users/9d26dacccf744cb7a2a26549ace91be1/roles/4ef4b944934e44a28a394ebd1a816f64 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:17.300711 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5853763-8c37-44ea-b0a7-6f90e63e300e None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:17.391749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d143013-9ebe-48ca-b725-faed45da325a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:17.426384 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:17.464228 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8422-3dd5-44d2-9f4a-60994d96f43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:17.464897 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8422-3dd5-44d2-9f4a-60994d96f43a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:17.465180 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8422-3dd5-44d2-9f4a-60994d96f43a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:17.465456 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8422-3dd5-44d2-9f4a-60994d96f43a None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:17.466707 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e8422-3dd5-44d2-9f4a-60994d96f43a None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:17.468378 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e8422-3dd5-44d2-9f4a-60994d96f43a None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:17.471746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 68/135] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:17 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:17.477655 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8422-3dd5-44d2-9f4a-60994d96f43a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:17.524223 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5853763-8c37-44ea-b0a7-6f90e63e300e None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:17.554498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:17.566493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114448d4-8bef-4124-9fa9-6e3115423962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:17.567154 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114448d4-8bef-4124-9fa9-6e3115423962 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:17.567430 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114448d4-8bef-4124-9fa9-6e3115423962 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:17.567700 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114448d4-8bef-4124-9fa9-6e3115423962 None admin] PATH_INFO: `/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:17.569163 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114448d4-8bef-4124-9fa9-6e3115423962 None admin] RBAC: Authorizing `identity:get_user(user_id=34cb0c8fda3c4c3db8e786e2db0c16cc)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:17.571548 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114448d4-8bef-4124-9fa9-6e3115423962 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:17.574033 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 68/136] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:17 2022] GET /identity/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:17.575356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114448d4-8bef-4124-9fa9-6e3115423962 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:17.639335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8422-3dd5-44d2-9f4a-60994d96f43a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:17.706648 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114448d4-8bef-4124-9fa9-6e3115423962 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:17.724553 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02e733-24e0-419c-87d1-3a1d84b07d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:17.725208 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02e733-24e0-419c-87d1-3a1d84b07d19 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:17.725491 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02e733-24e0-419c-87d1-3a1d84b07d19 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:17.725768 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02e733-24e0-419c-87d1-3a1d84b07d19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:17.728043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02e733-24e0-419c-87d1-3a1d84b07d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:17.729540 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02e733-24e0-419c-87d1-3a1d84b07d19 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:17.734517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 69/137] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:17.735333 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02e733-24e0-419c-87d1-3a1d84b07d19 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:17.741898 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:17.771392 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c01bae-0f9a-4ce4-ba03-5a8bdcadb76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:17.772550 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c01bae-0f9a-4ce4-ba03-5a8bdcadb76c None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:17.773097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c01bae-0f9a-4ce4-ba03-5a8bdcadb76c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:17.773573 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c01bae-0f9a-4ce4-ba03-5a8bdcadb76c None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/users/34cb0c8fda3c4c3db8e786e2db0c16cc/roles/cee2b2731e93403d9f425e05f6905b53` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:17.776447 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c01bae-0f9a-4ce4-ba03-5a8bdcadb76c None admin] RBAC: Authorizing `identity:create_grant(project_id=84253ede8aa34d9bb8638223c2d7ad79, user_id=34cb0c8fda3c4c3db8e786e2db0c16cc, role_id=cee2b2731e93403d9f425e05f6905b53)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:17.778399 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c01bae-0f9a-4ce4-ba03-5a8bdcadb76c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:17.802254 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 69/138] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:23:17 2022] PUT /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/users/34cb0c8fda3c4c3db8e786e2db0c16cc/roles/cee2b2731e93403d9f425e05f6905b53 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:17.803699 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c01bae-0f9a-4ce4-ba03-5a8bdcadb76c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:17.866732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02e733-24e0-419c-87d1-3a1d84b07d19 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:17.894464 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:17.919038 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343586ae-e8a5-472b-bc74-1d872d0dfb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:17.919038 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343586ae-e8a5-472b-bc74-1d872d0dfb20 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:17.919349 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343586ae-e8a5-472b-bc74-1d872d0dfb20 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:17.930041 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343586ae-e8a5-472b-bc74-1d872d0dfb20 None admin] PATH_INFO: `/v3/projects/0ea7d0269f09447999f1d16f4e39478b` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:17.930041 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343586ae-e8a5-472b-bc74-1d872d0dfb20 None admin] RBAC: Authorizing `identity:get_project(project_id=0ea7d0269f09447999f1d16f4e39478b)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:17.931840 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343586ae-e8a5-472b-bc74-1d872d0dfb20 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:17.942504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 70/139] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:17 2022] GET /identity/v3/projects/0ea7d0269f09447999f1d16f4e39478b => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:17.942504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e06432-6d7c-451b-8919-5d8cba41a1d7 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:17.942504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e06432-6d7c-451b-8919-5d8cba41a1d7 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:17.942504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e06432-6d7c-451b-8919-5d8cba41a1d7 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:17.942504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 71/140] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:17.954018 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e06432-6d7c-451b-8919-5d8cba41a1d7 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:18.070951 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c01bae-0f9a-4ce4-ba03-5a8bdcadb76c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:18.168000 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e06432-6d7c-451b-8919-5d8cba41a1d7 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:18.178018 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eed0ca-d59f-4383-acec-e757051dbdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:18.178018 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed0ca-d59f-4383-acec-e757051dbdb8 None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:18.178018 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed0ca-d59f-4383-acec-e757051dbdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:18.178018 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed0ca-d59f-4383-acec-e757051dbdb8 None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:18.178383 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eed0ca-d59f-4383-acec-e757051dbdb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:18.179418 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eed0ca-d59f-4383-acec-e757051dbdb8 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:18.210348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804432f-ce84-42ad-a1fa-dcec1e37995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:18.211238 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804432f-ce84-42ad-a1fa-dcec1e37995e None admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:18.211684 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804432f-ce84-42ad-a1fa-dcec1e37995e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:18.213348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804432f-ce84-42ad-a1fa-dcec1e37995e None admin] PATH_INFO: `/v3/projects/0ea7d0269f09447999f1d16f4e39478b/users/34cb0c8fda3c4c3db8e786e2db0c16cc/roles/848a48b503dc483fbbc428affa473937` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:18.219183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804432f-ce84-42ad-a1fa-dcec1e37995e None admin] RBAC: Authorizing `identity:create_grant(project_id=0ea7d0269f09447999f1d16f4e39478b, user_id=34cb0c8fda3c4c3db8e786e2db0c16cc, role_id=848a48b503dc483fbbc428affa473937)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:18.221326 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804432f-ce84-42ad-a1fa-dcec1e37995e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:18.250025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 70/141] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:23:17 2022] POST /identity/v3/users => generated 283 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:23:18.250025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ddd01-6e93-4478-b947-ca90811c7e35 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:18.250693 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 72/142] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:23:17 2022] PUT /identity/v3/projects/0ea7d0269f09447999f1d16f4e39478b/users/34cb0c8fda3c4c3db8e786e2db0c16cc/roles/848a48b503dc483fbbc428affa473937 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:18.250873 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ddd01-6e93-4478-b947-ca90811c7e35 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:18.251125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ddd01-6e93-4478-b947-ca90811c7e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:18.286387 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-f87ddd01-6e93-4478-b947-ca90811c7e35 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:18.289420 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-f87ddd01-6e93-4478-b947-ca90811c7e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:18.363630 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:18.452142 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 71/143] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:18.939175 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804432f-ce84-42ad-a1fa-dcec1e37995e None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:18.985213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:19.065180 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804432f-ce84-42ad-a1fa-dcec1e37995e None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:19.111310 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4a121-c556-4645-b56b-601f230f966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:19.111965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4a121-c556-4645-b56b-601f230f966a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:19.112242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4a121-c556-4645-b56b-601f230f966a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:19.112517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4a121-c556-4645-b56b-601f230f966a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:19.127550 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4a121-c556-4645-b56b-601f230f966a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-7ea4a121-c556-4645-b56b-601f230f966a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:19.132483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:19.133309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:19.134092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 73/144] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:19.141152 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ddd01-6e93-4478-b947-ca90811c7e35 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:19.275227 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ddd01-6e93-4478-b947-ca90811c7e35 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:19.321176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345f3e-2121-472e-bac0-c8947ff25d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:19.321901 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345f3e-2121-472e-bac0-c8947ff25d04 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:19.322258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345f3e-2121-472e-bac0-c8947ff25d04 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:19.322536 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345f3e-2121-472e-bac0-c8947ff25d04 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:19.323213 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345f3e-2121-472e-bac0-c8947ff25d04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:19.323513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345f3e-2121-472e-bac0-c8947ff25d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:19.324912 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345f3e-2121-472e-bac0-c8947ff25d04 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:19.341073 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 72/145] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:19.348359 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4a121-c556-4645-b56b-601f230f966a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:19.391551 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb2a49-3c10-4824-9518-d58042705249 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:19.391900 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb2a49-3c10-4824-9518-d58042705249 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:19.392736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb2a49-3c10-4824-9518-d58042705249 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:19.399288 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 73/146] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:19.406823 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdabd3-b54c-43a0-afa3-9f9c247bd0e2 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:19.407171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdabd3-b54c-43a0-afa3-9f9c247bd0e2 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:19.407452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdabd3-b54c-43a0-afa3-9f9c247bd0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:19.441608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-9ebdabd3-b54c-43a0-afa3-9f9c247bd0e2 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:19.442896 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-9ebdabd3-b54c-43a0-afa3-9f9c247bd0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:19.477185 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:19.479854 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:19.487014 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4a121-c556-4645-b56b-601f230f966a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:19.543657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cac6a3-6523-4e90-a9ae-a81b830c95ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:19.549917 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cac6a3-6523-4e90-a9ae-a81b830c95ed None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:19.550380 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cac6a3-6523-4e90-a9ae-a81b830c95ed None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:19.550669 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cac6a3-6523-4e90-a9ae-a81b830c95ed None admin] PATH_INFO: `/v3/users/d14ee78c11714801ac375212753b4676` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:19.552236 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cac6a3-6523-4e90-a9ae-a81b830c95ed None admin] RBAC: Authorizing `identity:get_user(user_id=d14ee78c11714801ac375212753b4676)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:19.553729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cac6a3-6523-4e90-a9ae-a81b830c95ed None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:19.556146 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 74/147] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:19 2022] GET /identity/v3/users/d14ee78c11714801ac375212753b4676 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:19.562403 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cac6a3-6523-4e90-a9ae-a81b830c95ed None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:19.611353 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 74/148] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:19.677500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cac6a3-6523-4e90-a9ae-a81b830c95ed None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:19.714461 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b562-baa5-41d0-9534-a8ba8aab367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:19.715104 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b562-baa5-41d0-9534-a8ba8aab367f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:19.715382 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b562-baa5-41d0-9534-a8ba8aab367f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:19.715654 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b562-baa5-41d0-9534-a8ba8aab367f None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:19.716778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b562-baa5-41d0-9534-a8ba8aab367f None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:19.718326 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b562-baa5-41d0-9534-a8ba8aab367f None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:19.719978 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 75/149] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:19 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:19.725899 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdabd3-b54c-43a0-afa3-9f9c247bd0e2 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:19.831516 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdabd3-b54c-43a0-afa3-9f9c247bd0e2 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:19.867903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dfafc-c877-41a8-92ba-2c155a0ef009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:19.868577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dfafc-c877-41a8-92ba-2c155a0ef009 None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:19.868850 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dfafc-c877-41a8-92ba-2c155a0ef009 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:19.869118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dfafc-c877-41a8-92ba-2c155a0ef009 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/users/d14ee78c11714801ac375212753b4676/roles/eb7fb540254848549730933af8f59dcb` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:19.871062 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80dfafc-c877-41a8-92ba-2c155a0ef009 None admin] RBAC: Authorizing `identity:create_grant(project_id=84253ede8aa34d9bb8638223c2d7ad79, user_id=d14ee78c11714801ac375212753b4676, role_id=eb7fb540254848549730933af8f59dcb)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:19.872513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80dfafc-c877-41a8-92ba-2c155a0ef009 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:19.894560 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 75/150] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:23:19 2022] PUT /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/users/d14ee78c11714801ac375212753b4676/roles/eb7fb540254848549730933af8f59dcb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:20.258929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b562-baa5-41d0-9534-a8ba8aab367f None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:20.297962 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:20.381221 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b562-baa5-41d0-9534-a8ba8aab367f None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:20.422349 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274046a8-3046-4d08-9fdf-c65612226fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:20.423004 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274046a8-3046-4d08-9fdf-c65612226fc5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:20.423282 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274046a8-3046-4d08-9fdf-c65612226fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:20.423551 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274046a8-3046-4d08-9fdf-c65612226fc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:20.435826 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274046a8-3046-4d08-9fdf-c65612226fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-274046a8-3046-4d08-9fdf-c65612226fc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:20.441245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:20.443634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:20.445562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 76/151] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:20.450758 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dfafc-c877-41a8-92ba-2c155a0ef009 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:20.465494 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:20.498840 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887f549-87c8-408c-8740-e78b28c40937 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:20.499171 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887f549-87c8-408c-8740-e78b28c40937 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:20.499379 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887f549-87c8-408c-8740-e78b28c40937 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:20.502312 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 77/152] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:20.511435 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2d689-27dc-441f-b058-5de7c20a040c None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:20.512481 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2d689-27dc-441f-b058-5de7c20a040c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:20.512955 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2d689-27dc-441f-b058-5de7c20a040c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:20.538571 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-99a2d689-27dc-441f-b058-5de7c20a040c None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:20.540596 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-99a2d689-27dc-441f-b058-5de7c20a040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:20.637578 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dfafc-c877-41a8-92ba-2c155a0ef009 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:20.715022 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59d6db-f555-4d50-af25-b39ef813fb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:20.715740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d6db-f555-4d50-af25-b39ef813fb83 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:20.716023 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d6db-f555-4d50-af25-b39ef813fb83 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:20.716294 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d6db-f555-4d50-af25-b39ef813fb83 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:20.717037 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59d6db-f555-4d50-af25-b39ef813fb83 None admin] RBAC: Adding query filter params (name=member) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:20.717372 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59d6db-f555-4d50-af25-b39ef813fb83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:20.719244 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59d6db-f555-4d50-af25-b39ef813fb83 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:20.733285 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 76/153] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:20.735555 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 78/154] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:20.745924 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59d6db-f555-4d50-af25-b39ef813fb83 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:20.864251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:20.890279 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59d6db-f555-4d50-af25-b39ef813fb83 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:20.934143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230841a-5138-4b4a-804e-b00b09a22c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:20.935242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230841a-5138-4b4a-804e-b00b09a22c1f None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:20.935519 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230841a-5138-4b4a-804e-b00b09a22c1f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:20.935793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230841a-5138-4b4a-804e-b00b09a22c1f None admin] PATH_INFO: `/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:20.937407 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230841a-5138-4b4a-804e-b00b09a22c1f None admin] RBAC: Authorizing `identity:get_user(user_id=34cb0c8fda3c4c3db8e786e2db0c16cc)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:20.938899 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230841a-5138-4b4a-804e-b00b09a22c1f None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:20.940507 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 77/155] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:20 2022] GET /identity/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:20.946714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2d689-27dc-441f-b058-5de7c20a040c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:20.981206 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:21.078211 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2d689-27dc-441f-b058-5de7c20a040c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:21.120057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b440c1-9cd0-4d8d-81f6-c7e1f188e916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:21.120674 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b440c1-9cd0-4d8d-81f6-c7e1f188e916 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:21.120950 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b440c1-9cd0-4d8d-81f6-c7e1f188e916 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:21.121222 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b440c1-9cd0-4d8d-81f6-c7e1f188e916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:21.214710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b440c1-9cd0-4d8d-81f6-c7e1f188e916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:21.216224 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b440c1-9cd0-4d8d-81f6-c7e1f188e916 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:21.243046 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:21.330596 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 79/156] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:21.337207 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230841a-5138-4b4a-804e-b00b09a22c1f None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:21.492880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230841a-5138-4b4a-804e-b00b09a22c1f None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:21.546054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c054f68-0826-4b7e-aa00-1bccf2b58cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:21.547387 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054f68-0826-4b7e-aa00-1bccf2b58cf6 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:21.547864 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054f68-0826-4b7e-aa00-1bccf2b58cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:21.548344 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054f68-0826-4b7e-aa00-1bccf2b58cf6 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:21.549774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c054f68-0826-4b7e-aa00-1bccf2b58cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:21.551649 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c054f68-0826-4b7e-aa00-1bccf2b58cf6 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:21.553582 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 78/157] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:21 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:21.559701 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b440c1-9cd0-4d8d-81f6-c7e1f188e916 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:21.690629 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c054f68-0826-4b7e-aa00-1bccf2b58cf6 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:21.707626 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b440c1-9cd0-4d8d-81f6-c7e1f188e916 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:21.724107 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:21.759805 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:21.788989 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78c4b4-babe-4df0-9ba9-9d8489d50c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:21.789620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c4b4-babe-4df0-9ba9-9d8489d50c48 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:21.789904 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c4b4-babe-4df0-9ba9-9d8489d50c48 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:21.790205 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c4b4-babe-4df0-9ba9-9d8489d50c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:21.790937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78c4b4-babe-4df0-9ba9-9d8489d50c48 None admin] RBAC: Adding query filter params (role.id=848a48b503dc483fbbc428affa473937, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79, user.id=34cb0c8fda3c4c3db8e786e2db0c16cc) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:21.791604 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78c4b4-babe-4df0-9ba9-9d8489d50c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:21.793057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78c4b4-babe-4df0-9ba9-9d8489d50c48 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:21.805156 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 80/158] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:21 2022] GET /identity/v3/role_assignments?user.id=34cb0c8fda3c4c3db8e786e2db0c16cc&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=848a48b503dc483fbbc428affa473937 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:21.885468 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c054f68-0826-4b7e-aa00-1bccf2b58cf6 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:21.931512 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa40f34-19db-4a7e-948b-fde9bbfdd6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:21.932548 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40f34-19db-4a7e-948b-fde9bbfdd6a9 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:21.933037 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40f34-19db-4a7e-948b-fde9bbfdd6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:21.933496 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40f34-19db-4a7e-948b-fde9bbfdd6a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:21.948369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa40f34-19db-4a7e-948b-fde9bbfdd6a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-7aa40f34-19db-4a7e-948b-fde9bbfdd6a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:21.954422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:21.955373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:21.956192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:21.958666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 79/159] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:23:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:23:21.967221 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78c4b4-babe-4df0-9ba9-9d8489d50c48 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:22.126134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78c4b4-babe-4df0-9ba9-9d8489d50c48 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:22.152933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ded67-a70e-41bd-b9d0-097d7633b023 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:22.153561 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ded67-a70e-41bd-b9d0-097d7633b023 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:22.154101 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ded67-a70e-41bd-b9d0-097d7633b023 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:22.155713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 80/160] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:22.172898 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927678d-8696-4ed7-90c6-706ae180a97a None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:22.173225 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433682c2-f891-4baa-a8e5-05d6e0945e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:22.173759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927678d-8696-4ed7-90c6-706ae180a97a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:22.173874 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433682c2-f891-4baa-a8e5-05d6e0945e59 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:22.174147 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433682c2-f891-4baa-a8e5-05d6e0945e59 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:22.174419 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433682c2-f891-4baa-a8e5-05d6e0945e59 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:22.174932 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927678d-8696-4ed7-90c6-706ae180a97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:22.175095 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433682c2-f891-4baa-a8e5-05d6e0945e59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:22.175382 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433682c2-f891-4baa-a8e5-05d6e0945e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:22.176774 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433682c2-f891-4baa-a8e5-05d6e0945e59 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:22.194606 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 81/161] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:22.203365 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433682c2-f891-4baa-a8e5-05d6e0945e59 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:22.214879 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-c927678d-8696-4ed7-90c6-706ae180a97a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:22.216407 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-c927678d-8696-4ed7-90c6-706ae180a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:22.305860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:22.336359 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 81/162] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:22.396144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433682c2-f891-4baa-a8e5-05d6e0945e59 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:22.447279 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507417b-85d8-4c6a-8409-20ecc615019f None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:22.448168 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507417b-85d8-4c6a-8409-20ecc615019f None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:22.448639 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507417b-85d8-4c6a-8409-20ecc615019f None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:22.450378 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 82/163] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:22.456289 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f7f0-bf2d-4c01-b2fa-630dc4ca194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:22.457012 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f7f0-bf2d-4c01-b2fa-630dc4ca194d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:22.457226 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f7f0-bf2d-4c01-b2fa-630dc4ca194d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:22.457458 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f7f0-bf2d-4c01-b2fa-630dc4ca194d None admin] PATH_INFO: `/v3/users/9d26dacccf744cb7a2a26549ace91be1` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:22.458216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dadbc-12bf-49b3-b862-b28f93321b3a None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:22.458865 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660f7f0-bf2d-4c01-b2fa-630dc4ca194d None admin] RBAC: Authorizing `identity:get_user(user_id=9d26dacccf744cb7a2a26549ace91be1)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:22.459666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dadbc-12bf-49b3-b862-b28f93321b3a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:22.460122 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660f7f0-bf2d-4c01-b2fa-630dc4ca194d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:22.460327 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dadbc-12bf-49b3-b862-b28f93321b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:22.466025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 82/164] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:22 2022] GET /identity/v3/users/9d26dacccf744cb7a2a26549ace91be1 => generated 247 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:22.474741 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:22.474920 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f7f0-bf2d-4c01-b2fa-630dc4ca194d None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:22.496308 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-1c3dadbc-12bf-49b3-b862-b28f93321b3a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:22.498513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-1c3dadbc-12bf-49b3-b862-b28f93321b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:22.612147 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 83/165] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:22.660289 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f7f0-bf2d-4c01-b2fa-630dc4ca194d None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:22.683602 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:22.710832 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b54e-c696-464f-995c-a89596cec0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:22.711450 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b54e-c696-464f-995c-a89596cec0ed None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:22.711722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b54e-c696-464f-995c-a89596cec0ed None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:22.711987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b54e-c696-464f-995c-a89596cec0ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:22.793260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332b54e-c696-464f-995c-a89596cec0ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:22.794845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332b54e-c696-464f-995c-a89596cec0ed None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:22.903349 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 83/166] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:23:22.909386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dadbc-12bf-49b3-b862-b28f93321b3a None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:22.952427 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b54e-c696-464f-995c-a89596cec0ed None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:22.979988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:23.098723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dadbc-12bf-49b3-b862-b28f93321b3a None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:23.136493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:23.139363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a68e79-05ea-41ff-b2a2-7196f2fee199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:23.140286 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a68e79-05ea-41ff-b2a2-7196f2fee199 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:23.140708 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a68e79-05ea-41ff-b2a2-7196f2fee199 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:23.141126 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a68e79-05ea-41ff-b2a2-7196f2fee199 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:23.142615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a68e79-05ea-41ff-b2a2-7196f2fee199 None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:23.144482 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a68e79-05ea-41ff-b2a2-7196f2fee199 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:23.147269 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 84/167] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:22 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:23.155046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a68e79-05ea-41ff-b2a2-7196f2fee199 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:23.157580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b54e-c696-464f-995c-a89596cec0ed None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:23.274679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812a3b4-36c9-45f7-a00e-2c6acf61f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:23.275319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a3b4-36c9-45f7-a00e-2c6acf61f5fd None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:23.275592 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a3b4-36c9-45f7-a00e-2c6acf61f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:23.275858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a3b4-36c9-45f7-a00e-2c6acf61f5fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:23.294661 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812a3b4-36c9-45f7-a00e-2c6acf61f5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-d812a3b4-36c9-45f7-a00e-2c6acf61f5fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:23.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:23.300898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:23.301694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:23.302319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a68e79-05ea-41ff-b2a2-7196f2fee199 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:23.302391 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 84/168] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:23:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:23:23.307086 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812a3b4-36c9-45f7-a00e-2c6acf61f5fd None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:23.362306 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74c9d-d5ea-4641-b106-3e9052eb8bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:23.362918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74c9d-d5ea-4641-b106-3e9052eb8bcf None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:23.363186 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74c9d-d5ea-4641-b106-3e9052eb8bcf None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:23.363445 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74c9d-d5ea-4641-b106-3e9052eb8bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:23.364167 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74c9d-d5ea-4641-b106-3e9052eb8bcf None admin] RBAC: Adding query filter params (role.id=4ef4b944934e44a28a394ebd1a816f64, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79, user.id=9d26dacccf744cb7a2a26549ace91be1) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:23.364468 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74c9d-d5ea-4641-b106-3e9052eb8bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:23.365922 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74c9d-d5ea-4641-b106-3e9052eb8bcf None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:23.383377 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 85/169] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:23 2022] GET /identity/v3/role_assignments?user.id=9d26dacccf744cb7a2a26549ace91be1&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:23.384061 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74c9d-d5ea-4641-b106-3e9052eb8bcf None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:23.445187 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:23.497110 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812a3b4-36c9-45f7-a00e-2c6acf61f5fd None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:23.529262 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:23.567945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8f78d-1dd0-478b-9ae7-8c1a54422bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:23.568616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8f78d-1dd0-478b-9ae7-8c1a54422bfb None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:23.568895 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8f78d-1dd0-478b-9ae7-8c1a54422bfb None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:23.569168 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8f78d-1dd0-478b-9ae7-8c1a54422bfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:23.589543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8f78d-1dd0-478b-9ae7-8c1a54422bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-3cb8f78d-1dd0-478b-9ae7-8c1a54422bfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:23.595384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:23.597799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:23.599769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:23.601571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74c9d-d5ea-4641-b106-3e9052eb8bcf None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:23.601734 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 85/170] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:23:23.606045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8f78d-1dd0-478b-9ae7-8c1a54422bfb None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:23.674834 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a76b-6b5a-472d-9cf9-50ac1fb70e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:23.675456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a76b-6b5a-472d-9cf9-50ac1fb70e31 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:23.675733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a76b-6b5a-472d-9cf9-50ac1fb70e31 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:23.676005 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a76b-6b5a-472d-9cf9-50ac1fb70e31 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:23.676678 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a76b-6b5a-472d-9cf9-50ac1fb70e31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:23.676977 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a76b-6b5a-472d-9cf9-50ac1fb70e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:23.680860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a76b-6b5a-472d-9cf9-50ac1fb70e31 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:23.701425 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 86/171] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:23:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:23.705682 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d57de5-e1bf-4ad6-822f-4ea9a36ee505 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:23.706340 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d57de5-e1bf-4ad6-822f-4ea9a36ee505 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:23.707464 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d57de5-e1bf-4ad6-822f-4ea9a36ee505 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:23.708995 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 87/172] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:23.710183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d57de5-e1bf-4ad6-822f-4ea9a36ee505 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:23.832662 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8f78d-1dd0-478b-9ae7-8c1a54422bfb None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:23.904820 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d57de5-e1bf-4ad6-822f-4ea9a36ee505 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:23.920992 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b1d80-494e-4512-8a88-c74bab48b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:23.920992 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b1d80-494e-4512-8a88-c74bab48b738 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:23.920992 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b1d80-494e-4512-8a88-c74bab48b738 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:23.920992 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b1d80-494e-4512-8a88-c74bab48b738 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:23.921395 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b1d80-494e-4512-8a88-c74bab48b738 None admin] RBAC: Adding query filter params (name=member) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:23.921395 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b1d80-494e-4512-8a88-c74bab48b738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:23.922604 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b1d80-494e-4512-8a88-c74bab48b738 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:23.927086 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:23.942071 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 86/173] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:23.946043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fbc30-b144-458a-93c0-352ae6459248 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:23.946043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fbc30-b144-458a-93c0-352ae6459248 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:23.946043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fbc30-b144-458a-93c0-352ae6459248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:23.946313 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:23.953169 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0954bb8-cb05-440b-aca7-b1c833a1fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:23.954090 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0954bb8-cb05-440b-aca7-b1c833a1fd5c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:23.954541 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0954bb8-cb05-440b-aca7-b1c833a1fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:23.954981 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0954bb8-cb05-440b-aca7-b1c833a1fd5c None admin] PATH_INFO: `/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:23.956403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0954bb8-cb05-440b-aca7-b1c833a1fd5c None admin] RBAC: Authorizing `identity:get_user(user_id=34cb0c8fda3c4c3db8e786e2db0c16cc)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:23.958183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0954bb8-cb05-440b-aca7-b1c833a1fd5c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:23.960337 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 88/174] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:23 2022] GET /identity/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:23.961279 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0954bb8-cb05-440b-aca7-b1c833a1fd5c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:23.986404 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-776fbc30-b144-458a-93c0-352ae6459248 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:23.989633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-776fbc30-b144-458a-93c0-352ae6459248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:24.081144 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0954bb8-cb05-440b-aca7-b1c833a1fd5c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:24.111399 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 87/175] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:24.112385 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fbc30-b144-458a-93c0-352ae6459248 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:24.121240 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01b695-e935-40ee-8589-96a650b9515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:24.122237 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b695-e935-40ee-8589-96a650b9515a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.122791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b695-e935-40ee-8589-96a650b9515a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.123267 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b695-e935-40ee-8589-96a650b9515a None admin] PATH_INFO: `/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.124811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01b695-e935-40ee-8589-96a650b9515a None admin] RBAC: Authorizing `identity:get_user(user_id=34cb0c8fda3c4c3db8e786e2db0c16cc)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:24.126626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01b695-e935-40ee-8589-96a650b9515a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:24.128525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 89/176] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:23 2022] GET /identity/v3/users/34cb0c8fda3c4c3db8e786e2db0c16cc => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:24.130068 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2722cca-be1c-4899-970e-d52f0a0f0ee8 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.135620 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2722cca-be1c-4899-970e-d52f0a0f0ee8 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.136308 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2722cca-be1c-4899-970e-d52f0a0f0ee8 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.138062 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 90/177] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:24.139019 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2722cca-be1c-4899-970e-d52f0a0f0ee8 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:24.210511 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:24.259349 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2722cca-be1c-4899-970e-d52f0a0f0ee8 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:24.281588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fbc30-b144-458a-93c0-352ae6459248 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:24.327608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760c89e-72a0-4d6d-bab4-e0bbd2fc376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:24.328251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760c89e-72a0-4d6d-bab4-e0bbd2fc376d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.328530 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760c89e-72a0-4d6d-bab4-e0bbd2fc376d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.328798 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760c89e-72a0-4d6d-bab4-e0bbd2fc376d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.334516 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:24.342382 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc4228-c66b-48e0-845b-e3924d2cd732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:24.343430 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc4228-c66b-48e0-845b-e3924d2cd732 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.343986 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc4228-c66b-48e0-845b-e3924d2cd732 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.344465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc4228-c66b-48e0-845b-e3924d2cd732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.425857 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc4228-c66b-48e0-845b-e3924d2cd732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:24.427280 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc4228-c66b-48e0-845b-e3924d2cd732 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:24.428401 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760c89e-72a0-4d6d-bab4-e0bbd2fc376d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:24.431369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760c89e-72a0-4d6d-bab4-e0bbd2fc376d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:24.503533 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:24.546038 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 91/178] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:24.547319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abfb82-ecf0-4c8a-a4b2-08749da43bc7 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.547579 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abfb82-ecf0-4c8a-a4b2-08749da43bc7 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.547899 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abfb82-ecf0-4c8a-a4b2-08749da43bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.552813 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 88/179] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:24.553925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c6dd2-62bd-4d3c-bdc4-7f7957b69e22 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.554432 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c6dd2-62bd-4d3c-bdc4-7f7957b69e22 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.554813 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c6dd2-62bd-4d3c-bdc4-7f7957b69e22 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.557626 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 89/180] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:24.558528 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07c8cb-9131-4bc1-b0c6-5004eb563e9f None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.558807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07c8cb-9131-4bc1-b0c6-5004eb563e9f None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.559076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07c8cb-9131-4bc1-b0c6-5004eb563e9f None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.560255 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 90/181] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:24.560970 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07c8cb-9131-4bc1-b0c6-5004eb563e9f None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:24.570325 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-48abfb82-ecf0-4c8a-a4b2-08749da43bc7 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:24.571518 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-48abfb82-ecf0-4c8a-a4b2-08749da43bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:24.589652 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:24.637857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 92/182] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:24.639230 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abfb82-ecf0-4c8a-a4b2-08749da43bc7 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:24.670268 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07c8cb-9131-4bc1-b0c6-5004eb563e9f None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:24.709453 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637370bb-5652-49dc-b861-57693a27cc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:24.710034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637370bb-5652-49dc-b861-57693a27cc67 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.710318 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637370bb-5652-49dc-b861-57693a27cc67 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.710587 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637370bb-5652-49dc-b861-57693a27cc67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.721526 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637370bb-5652-49dc-b861-57693a27cc67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-637370bb-5652-49dc-b861-57693a27cc67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:24.726335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:24.727350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 91/183] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:23:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:24.733246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637370bb-5652-49dc-b861-57693a27cc67 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:24.751777 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:24.761680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abfb82-ecf0-4c8a-a4b2-08749da43bc7 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:24.797771 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc74871-4a2f-4da1-b5f1-a06da7732591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:24.798741 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc74871-4a2f-4da1-b5f1-a06da7732591 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.799212 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc74871-4a2f-4da1-b5f1-a06da7732591 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.799661 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc74871-4a2f-4da1-b5f1-a06da7732591 None admin] PATH_INFO: `/v3/projects/0ea7d0269f09447999f1d16f4e39478b` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.800990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc74871-4a2f-4da1-b5f1-a06da7732591 None admin] RBAC: Authorizing `identity:get_project(project_id=0ea7d0269f09447999f1d16f4e39478b)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:24.802653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc74871-4a2f-4da1-b5f1-a06da7732591 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:24.804856 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 93/184] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:24 2022] GET /identity/v3/projects/0ea7d0269f09447999f1d16f4e39478b => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:24.806158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc7dcb-3493-412f-93f3-b50fe7d81c09 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.806432 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc7dcb-3493-412f-93f3-b50fe7d81c09 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.806691 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc7dcb-3493-412f-93f3-b50fe7d81c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.823705 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-25cc7dcb-3493-412f-93f3-b50fe7d81c09 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:24.824890 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-25cc7dcb-3493-412f-93f3-b50fe7d81c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:24.828724 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:24.841258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637370bb-5652-49dc-b861-57693a27cc67 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:24.883120 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6e616-214b-402c-b4b4-01c3d7ecce0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:24.883752 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6e616-214b-402c-b4b4-01c3d7ecce0c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.884027 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6e616-214b-402c-b4b4-01c3d7ecce0c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.884293 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6e616-214b-402c-b4b4-01c3d7ecce0c None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.885416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6e616-214b-402c-b4b4-01c3d7ecce0c None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:24.886913 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6e616-214b-402c-b4b4-01c3d7ecce0c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:24.888701 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 92/185] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:24 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:24.889846 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be779aa-f26b-4048-981c-44e202bf908a None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:24.890144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be779aa-f26b-4048-981c-44e202bf908a None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:24.890514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be779aa-f26b-4048-981c-44e202bf908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:24.903874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 94/186] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:24.904615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc7dcb-3493-412f-93f3-b50fe7d81c09 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:24.913026 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-1be779aa-f26b-4048-981c-44e202bf908a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:24.914917 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-1be779aa-f26b-4048-981c-44e202bf908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:24.988657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 93/187] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:24.989783 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be779aa-f26b-4048-981c-44e202bf908a None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:25.012913 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:25.030421 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc7dcb-3493-412f-93f3-b50fe7d81c09 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:25.077346 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b715543-d0af-4864-a15d-6b2ea59d0a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:25.078643 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b715543-d0af-4864-a15d-6b2ea59d0a02 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.080016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b715543-d0af-4864-a15d-6b2ea59d0a02 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.080496 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b715543-d0af-4864-a15d-6b2ea59d0a02 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.081362 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b715543-d0af-4864-a15d-6b2ea59d0a02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:25.081869 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b715543-d0af-4864-a15d-6b2ea59d0a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:25.083481 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b715543-d0af-4864-a15d-6b2ea59d0a02 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:25.095257 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:25.096872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 95/188] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:25.097985 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b715543-d0af-4864-a15d-6b2ea59d0a02 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:25.115289 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be779aa-f26b-4048-981c-44e202bf908a None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:25.153871 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3eb8f-3650-455e-8362-e36c097b7018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:25.154513 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3eb8f-3650-455e-8362-e36c097b7018 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.155114 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3eb8f-3650-455e-8362-e36c097b7018 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.155485 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3eb8f-3650-455e-8362-e36c097b7018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.156214 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3eb8f-3650-455e-8362-e36c097b7018 None admin] RBAC: Adding query filter params (role.id=848a48b503dc483fbbc428affa473937, scope.project.id=0ea7d0269f09447999f1d16f4e39478b, user.id=34cb0c8fda3c4c3db8e786e2db0c16cc) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:25.156517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3eb8f-3650-455e-8362-e36c097b7018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:25.158566 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3eb8f-3650-455e-8362-e36c097b7018 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:25.167136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 94/189] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:24 2022] GET /identity/v3/role_assignments?user.id=34cb0c8fda3c4c3db8e786e2db0c16cc&scope.project.id=0ea7d0269f09447999f1d16f4e39478b&role.id=848a48b503dc483fbbc428affa473937 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:25.168128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3eb8f-3650-455e-8362-e36c097b7018 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:25.286209 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b715543-d0af-4864-a15d-6b2ea59d0a02 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:25.324917 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb566f4-078f-423b-b458-4b60c5b6c4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:25.325611 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb566f4-078f-423b-b458-4b60c5b6c4cd None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.325890 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb566f4-078f-423b-b458-4b60c5b6c4cd None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.326190 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb566f4-078f-423b-b458-4b60c5b6c4cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.327003 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb566f4-078f-423b-b458-4b60c5b6c4cd None admin] RBAC: Adding query filter params (role.id=cee2b2731e93403d9f425e05f6905b53, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79, user.id=34cb0c8fda3c4c3db8e786e2db0c16cc) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:25.327307 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb566f4-078f-423b-b458-4b60c5b6c4cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:25.328785 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb566f4-078f-423b-b458-4b60c5b6c4cd None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:25.335670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 96/190] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:25 2022] GET /identity/v3/role_assignments?user.id=34cb0c8fda3c4c3db8e786e2db0c16cc&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=cee2b2731e93403d9f425e05f6905b53 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:25.336543 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb566f4-078f-423b-b458-4b60c5b6c4cd None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:25.349773 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3eb8f-3650-455e-8362-e36c097b7018 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:25.358531 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:25.409118 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559b74e-1169-42b9-a7df-d523b27d8f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:25.409782 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b74e-1169-42b9-a7df-d523b27d8f91 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.410152 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b74e-1169-42b9-a7df-d523b27d8f91 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.410426 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b74e-1169-42b9-a7df-d523b27d8f91 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.425182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559b74e-1169-42b9-a7df-d523b27d8f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-9559b74e-1169-42b9-a7df-d523b27d8f91 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:25.431620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:25.432560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:25.433433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 95/191] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:25.434119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559b74e-1169-42b9-a7df-d523b27d8f91 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:25.454381 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:25.484401 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb566f4-078f-423b-b458-4b60c5b6c4cd None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:25.527799 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf9a8f-05d0-462b-8f26-e8f8fdf90975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:25.528440 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf9a8f-05d0-462b-8f26-e8f8fdf90975 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.528713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf9a8f-05d0-462b-8f26-e8f8fdf90975 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.529001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf9a8f-05d0-462b-8f26-e8f8fdf90975 None admin] PATH_INFO: `/v3/users/b6e7fac37b8c48b0a3c9a865704eddae` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.544335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf9a8f-05d0-462b-8f26-e8f8fdf90975 None admin] RBAC: Authorizing `identity:get_user(user_id=b6e7fac37b8c48b0a3c9a865704eddae)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:25.545859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf9a8f-05d0-462b-8f26-e8f8fdf90975 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:25.547783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 97/192] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:25 2022] GET /identity/v3/users/b6e7fac37b8c48b0a3c9a865704eddae => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:25.548479 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf9a8f-05d0-462b-8f26-e8f8fdf90975 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:25.567919 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559b74e-1169-42b9-a7df-d523b27d8f91 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:25.607402 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916a4ee-e2aa-4b19-b28a-7405cb8ddfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:25.608182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916a4ee-e2aa-4b19-b28a-7405cb8ddfdc None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.608466 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916a4ee-e2aa-4b19-b28a-7405cb8ddfdc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.608740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916a4ee-e2aa-4b19-b28a-7405cb8ddfdc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.620533 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916a4ee-e2aa-4b19-b28a-7405cb8ddfdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-8916a4ee-e2aa-4b19-b28a-7405cb8ddfdc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:25.626088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:25.627182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 96/193] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:23:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:25.628108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916a4ee-e2aa-4b19-b28a-7405cb8ddfdc None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:25.648162 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:25.673640 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf9a8f-05d0-462b-8f26-e8f8fdf90975 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:25.698854 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:25.709763 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82b308-ca29-46e5-8d61-d81f2e78895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:25.710590 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82b308-ca29-46e5-8d61-d81f2e78895b None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.710866 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82b308-ca29-46e5-8d61-d81f2e78895b None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.711135 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82b308-ca29-46e5-8d61-d81f2e78895b None admin] PATH_INFO: `/v3/domains/default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.712246 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82b308-ca29-46e5-8d61-d81f2e78895b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:25.713714 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82b308-ca29-46e5-8d61-d81f2e78895b None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:25.715297 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 98/194] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:25.718838 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82b308-ca29-46e5-8d61-d81f2e78895b None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:25.731772 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916a4ee-e2aa-4b19-b28a-7405cb8ddfdc None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:25.765769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5fc31-8fb3-4cd5-b85e-481786cf83f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:25.766412 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5fc31-8fb3-4cd5-b85e-481786cf83f4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.766700 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5fc31-8fb3-4cd5-b85e-481786cf83f4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.766964 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5fc31-8fb3-4cd5-b85e-481786cf83f4 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.767624 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5fc31-8fb3-4cd5-b85e-481786cf83f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:25.767925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5fc31-8fb3-4cd5-b85e-481786cf83f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:25.769324 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5fc31-8fb3-4cd5-b85e-481786cf83f4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:25.777760 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 97/195] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:25.777760 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5fc31-8fb3-4cd5-b85e-481786cf83f4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:25.822447 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82b308-ca29-46e5-8d61-d81f2e78895b None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:25.856793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a46e9f-93ed-417f-b600-25501d55112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:25.857405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a46e9f-93ed-417f-b600-25501d55112e None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.857679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a46e9f-93ed-417f-b600-25501d55112e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.857980 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a46e9f-93ed-417f-b600-25501d55112e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.870211 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:25.878573 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5fc31-8fb3-4cd5-b85e-481786cf83f4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:25.907888 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:25.912968 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5089b7e-abcc-477c-9792-1202f259c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:25.913577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5089b7e-abcc-477c-9792-1202f259c195 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.913847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5089b7e-abcc-477c-9792-1202f259c195 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.914147 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5089b7e-abcc-477c-9792-1202f259c195 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.914814 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5089b7e-abcc-477c-9792-1202f259c195 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:25.915119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5089b7e-abcc-477c-9792-1202f259c195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:25.916887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5089b7e-abcc-477c-9792-1202f259c195 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:25.925082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 98/196] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:23:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:25.929882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5089b7e-abcc-477c-9792-1202f259c195 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:25.929984 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a46e9f-93ed-417f-b600-25501d55112e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:25.929984 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a46e9f-93ed-417f-b600-25501d55112e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:26.021919 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5089b7e-abcc-477c-9792-1202f259c195 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:26.024643 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 99/197] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:26.025590 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a46e9f-93ed-417f-b600-25501d55112e None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:26.056219 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e2879-34d5-4b28-b9ba-e5befc61518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:26.056831 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e2879-34d5-4b28-b9ba-e5befc61518c None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:26.057108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e2879-34d5-4b28-b9ba-e5befc61518c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:26.057370 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e2879-34d5-4b28-b9ba-e5befc61518c None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:26.058037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e2879-34d5-4b28-b9ba-e5befc61518c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:26.059509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e2879-34d5-4b28-b9ba-e5befc61518c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:26.070576 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:26.086771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 99/198] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:23:25 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:23:26.087527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e2879-34d5-4b28-b9ba-e5befc61518c None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:26.140573 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a46e9f-93ed-417f-b600-25501d55112e None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:26.143706 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:26.196627 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4bbdc-4dce-4fa6-9b9e-ce59c224f0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:26.197323 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4bbdc-4dce-4fa6-9b9e-ce59c224f0d8 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:26.197597 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4bbdc-4dce-4fa6-9b9e-ce59c224f0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:26.197864 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4bbdc-4dce-4fa6-9b9e-ce59c224f0d8 None admin] PATH_INFO: `/v3/users/d14ee78c11714801ac375212753b4676` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:26.199053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4bbdc-4dce-4fa6-9b9e-ce59c224f0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=d14ee78c11714801ac375212753b4676)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:26.200495 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4bbdc-4dce-4fa6-9b9e-ce59c224f0d8 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:26.202220 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 100/199] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:26 2022] GET /identity/v3/users/d14ee78c11714801ac375212753b4676 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:26.203021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4bbdc-4dce-4fa6-9b9e-ce59c224f0d8 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:26.213878 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e2879-34d5-4b28-b9ba-e5befc61518c None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:26.256416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bf696-971c-445c-b7bd-8b9d063d5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:26.257107 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bf696-971c-445c-b7bd-8b9d063d5d31 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:26.257396 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bf696-971c-445c-b7bd-8b9d063d5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:26.257663 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bf696-971c-445c-b7bd-8b9d063d5d31 None admin] PATH_INFO: `/v3/users/b6e7fac37b8c48b0a3c9a865704eddae` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:26.258926 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bf696-971c-445c-b7bd-8b9d063d5d31 None admin] RBAC: Authorizing `identity:get_user(user_id=b6e7fac37b8c48b0a3c9a865704eddae)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:26.260447 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bf696-971c-445c-b7bd-8b9d063d5d31 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:26.262132 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 100/200] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:26 2022] GET /identity/v3/users/b6e7fac37b8c48b0a3c9a865704eddae => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:26.262950 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bf696-971c-445c-b7bd-8b9d063d5d31 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:26.329289 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4bbdc-4dce-4fa6-9b9e-ce59c224f0d8 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:26.341527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:26.374892 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c8642-a706-4ec2-a580-1f9aa9d12846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:26.375544 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c8642-a706-4ec2-a580-1f9aa9d12846 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:26.375848 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c8642-a706-4ec2-a580-1f9aa9d12846 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:26.376083 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c8642-a706-4ec2-a580-1f9aa9d12846 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:26.377227 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c8642-a706-4ec2-a580-1f9aa9d12846 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:26.378912 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c8642-a706-4ec2-a580-1f9aa9d12846 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:26.380461 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 101/201] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:26 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:26.382881 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c8642-a706-4ec2-a580-1f9aa9d12846 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:26.386575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bf696-971c-445c-b7bd-8b9d063d5d31 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:26.418320 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:26.434421 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c0f87-4ed6-48b3-ac89-31201ad314e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:26.435211 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c0f87-4ed6-48b3-ac89-31201ad314e1 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:26.435583 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c0f87-4ed6-48b3-ac89-31201ad314e1 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:26.436320 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c0f87-4ed6-48b3-ac89-31201ad314e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:26.526732 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c8642-a706-4ec2-a580-1f9aa9d12846 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:26.533830 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c0f87-4ed6-48b3-ac89-31201ad314e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:26.535536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c0f87-4ed6-48b3-ac89-31201ad314e1 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:26.563624 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eaf5c-6547-41ac-980e-3acf7b65b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:26.564403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eaf5c-6547-41ac-980e-3acf7b65b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:26.564770 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eaf5c-6547-41ac-980e-3acf7b65b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:26.565166 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eaf5c-6547-41ac-980e-3acf7b65b6c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:26.633758 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25eaf5c-6547-41ac-980e-3acf7b65b6c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:26.635371 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25eaf5c-6547-41ac-980e-3acf7b65b6c0 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:26.638529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:26.681020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 101/202] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:26.683187 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c0f87-4ed6-48b3-ac89-31201ad314e1 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:26.709716 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:26.758136 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 102/203] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:26.760669 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eaf5c-6547-41ac-980e-3acf7b65b6c0 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:26.808623 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c0f87-4ed6-48b3-ac89-31201ad314e1 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:26.848589 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230ad5b-abbc-4c33-9c51-452c60a56b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:26.849556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230ad5b-abbc-4c33-9c51-452c60a56b1d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:26.849976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230ad5b-abbc-4c33-9c51-452c60a56b1d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:26.850428 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230ad5b-abbc-4c33-9c51-452c60a56b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:26.851398 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230ad5b-abbc-4c33-9c51-452c60a56b1d None admin] RBAC: Adding query filter params (role.id=4ef4b944934e44a28a394ebd1a816f64, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60, user.id=b6e7fac37b8c48b0a3c9a865704eddae) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:26.852001 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230ad5b-abbc-4c33-9c51-452c60a56b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:26.853625 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230ad5b-abbc-4c33-9c51-452c60a56b1d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:26.860516 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:26.861790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 102/204] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:26 2022] GET /identity/v3/role_assignments?user.id=b6e7fac37b8c48b0a3c9a865704eddae&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:26.862887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230ad5b-abbc-4c33-9c51-452c60a56b1d None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:26.901790 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eaf5c-6547-41ac-980e-3acf7b65b6c0 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:26.960010 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:26.978815 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74aca65-6d81-4c3f-89ba-d8411e09c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:26.979656 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74aca65-6d81-4c3f-89ba-d8411e09c21e None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:26.980032 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74aca65-6d81-4c3f-89ba-d8411e09c21e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:26.980402 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74aca65-6d81-4c3f-89ba-d8411e09c21e None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:26.981386 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230ad5b-abbc-4c33-9c51-452c60a56b1d None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:26.982296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74aca65-6d81-4c3f-89ba-d8411e09c21e None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:26.984377 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74aca65-6d81-4c3f-89ba-d8411e09c21e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:26.994537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 103/205] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:26 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:27.000983 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74aca65-6d81-4c3f-89ba-d8411e09c21e None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:27.025374 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cec2e-6f61-476d-bbc1-ee076e8c7923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:27.026401 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cec2e-6f61-476d-bbc1-ee076e8c7923 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:27.026872 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cec2e-6f61-476d-bbc1-ee076e8c7923 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:27.027393 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cec2e-6f61-476d-bbc1-ee076e8c7923 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:27.028853 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cec2e-6f61-476d-bbc1-ee076e8c7923 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:27.031066 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cec2e-6f61-476d-bbc1-ee076e8c7923 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:27.033425 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 103/206] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:26 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:27.042616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cec2e-6f61-476d-bbc1-ee076e8c7923 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:27.175716 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74aca65-6d81-4c3f-89ba-d8411e09c21e None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:27.202834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cec2e-6f61-476d-bbc1-ee076e8c7923 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:27.245575 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799d6a9-3295-4e04-bd8b-7ff503629c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:27.246568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799d6a9-3295-4e04-bd8b-7ff503629c69 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:27.247039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799d6a9-3295-4e04-bd8b-7ff503629c69 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:27.247518 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799d6a9-3295-4e04-bd8b-7ff503629c69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:27.248545 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799d6a9-3295-4e04-bd8b-7ff503629c69 None admin] RBAC: Adding query filter params (role.id=eb7fb540254848549730933af8f59dcb, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79, user.id=d14ee78c11714801ac375212753b4676) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:27.249766 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799d6a9-3295-4e04-bd8b-7ff503629c69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:27.251444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799d6a9-3295-4e04-bd8b-7ff503629c69 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:27.262303 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 104/207] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:26 2022] GET /identity/v3/role_assignments?user.id=d14ee78c11714801ac375212753b4676&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=eb7fb540254848549730933af8f59dcb => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:27.273219 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb28c1f-80fc-464c-9fd2-050a49a700bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:27.274279 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28c1f-80fc-464c-9fd2-050a49a700bc None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:27.274752 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28c1f-80fc-464c-9fd2-050a49a700bc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:27.275237 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28c1f-80fc-464c-9fd2-050a49a700bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:27.276156 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb28c1f-80fc-464c-9fd2-050a49a700bc None admin] RBAC: Adding query filter params (role.id=cee2b2731e93403d9f425e05f6905b53, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60, user.id=b6e7fac37b8c48b0a3c9a865704eddae) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:27.276672 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb28c1f-80fc-464c-9fd2-050a49a700bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:27.278347 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb28c1f-80fc-464c-9fd2-050a49a700bc None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:27.291497 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 104/208] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:27 2022] GET /identity/v3/role_assignments?user.id=b6e7fac37b8c48b0a3c9a865704eddae&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=cee2b2731e93403d9f425e05f6905b53 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:28.578318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbbb0c-2b31-40f5-a597-e817f52d8a12 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:28.578892 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbbb0c-2b31-40f5-a597-e817f52d8a12 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:28.578892 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbbb0c-2b31-40f5-a597-e817f52d8a12 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:28.580436 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 105/209] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:28.585908 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb6880-ecba-44a4-b8e9-58626557a04c None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:28.586345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb6880-ecba-44a4-b8e9-58626557a04c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:28.586533 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb6880-ecba-44a4-b8e9-58626557a04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:28.606640 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-80bb6880-ecba-44a4-b8e9-58626557a04c None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:28.607906 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-80bb6880-ecba-44a4-b8e9-58626557a04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:28.612952 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bffed7-d859-41a5-b459-35e50d2053d3 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:28.613232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bffed7-d859-41a5-b459-35e50d2053d3 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:28.613527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bffed7-d859-41a5-b459-35e50d2053d3 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:28.615034 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 106/210] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:28.618155 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:28.621654 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f42ab7-0445-4091-9785-20969399ec38 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:28.621935 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f42ab7-0445-4091-9785-20969399ec38 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:28.622251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f42ab7-0445-4091-9785-20969399ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:28.646188 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-02f42ab7-0445-4091-9785-20969399ec38 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:28.648524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-02f42ab7-0445-4091-9785-20969399ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:28.651530 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:28.687632 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 105/211] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:28.733495 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 107/212] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:29.015801 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb6880-ecba-44a4-b8e9-58626557a04c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:29.075434 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f42ab7-0445-4091-9785-20969399ec38 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:29.124379 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb6880-ecba-44a4-b8e9-58626557a04c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:29.167675 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b3a70-b545-484e-89ca-80c9a3d136a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:29.168347 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b3a70-b545-484e-89ca-80c9a3d136a8 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.168630 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b3a70-b545-484e-89ca-80c9a3d136a8 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.168905 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b3a70-b545-484e-89ca-80c9a3d136a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.170661 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b3a70-b545-484e-89ca-80c9a3d136a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:29.171955 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b3a70-b545-484e-89ca-80c9a3d136a8 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:29.178742 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 106/213] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:29.180012 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b3a70-b545-484e-89ca-80c9a3d136a8 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:29.197652 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:29.208159 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f42ab7-0445-4091-9785-20969399ec38 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:29.243972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf457fc-c62a-44b1-bdbf-0f2019b22b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:29.244887 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf457fc-c62a-44b1-bdbf-0f2019b22b63 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.245489 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf457fc-c62a-44b1-bdbf-0f2019b22b63 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.245896 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf457fc-c62a-44b1-bdbf-0f2019b22b63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.254181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:29.257668 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf457fc-c62a-44b1-bdbf-0f2019b22b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-0cf457fc-c62a-44b1-bdbf-0f2019b22b63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:29.262947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:29.264089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:29.265029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:29.267306 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 108/214] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:29.274049 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf457fc-c62a-44b1-bdbf-0f2019b22b63 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:29.296397 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b3a70-b545-484e-89ca-80c9a3d136a8 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:29.341565 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c46e-0be7-4917-bd9a-4b326e7f497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:29.342414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c46e-0be7-4917-bd9a-4b326e7f497e None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.342714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c46e-0be7-4917-bd9a-4b326e7f497e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.342986 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c46e-0be7-4917-bd9a-4b326e7f497e None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.343631 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3c46e-0be7-4917-bd9a-4b326e7f497e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:29.345177 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3c46e-0be7-4917-bd9a-4b326e7f497e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:29.375740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 107/215] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:23:29 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:23:29.375740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87858ab9-9049-4e3e-85bb-92a677c44c96 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.375740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87858ab9-9049-4e3e-85bb-92a677c44c96 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.375740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87858ab9-9049-4e3e-85bb-92a677c44c96 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.375740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 108/216] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:29.378279 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48f30-0abf-4f95-927c-d71e0b2430f4 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.378613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48f30-0abf-4f95-927c-d71e0b2430f4 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.378881 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48f30-0abf-4f95-927c-d71e0b2430f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.398300 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-b2a48f30-0abf-4f95-927c-d71e0b2430f4 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:29.399515 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-b2a48f30-0abf-4f95-927c-d71e0b2430f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:29.411612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf457fc-c62a-44b1-bdbf-0f2019b22b63 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:29.462050 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f38d6f-c563-486f-a1be-00557f3c424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:29.462508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38d6f-c563-486f-a1be-00557f3c424f None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.462781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38d6f-c563-486f-a1be-00557f3c424f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.463049 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38d6f-c563-486f-a1be-00557f3c424f None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.463763 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f38d6f-c563-486f-a1be-00557f3c424f None admin] RBAC: Adding query filter params (name=member) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:29.464060 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f38d6f-c563-486f-a1be-00557f3c424f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:29.465870 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f38d6f-c563-486f-a1be-00557f3c424f None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:29.481553 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:29.481746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 109/217] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:29.483120 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f38d6f-c563-486f-a1be-00557f3c424f None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:29.490386 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 109/218] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:29.558072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:29.600510 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f38d6f-c563-486f-a1be-00557f3c424f None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:29.635862 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a17186-d595-42dc-8c35-34955bfd74ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:29.636509 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a17186-d595-42dc-8c35-34955bfd74ba None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.636779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a17186-d595-42dc-8c35-34955bfd74ba None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.637046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a17186-d595-42dc-8c35-34955bfd74ba None admin] PATH_INFO: `/v3/users/ea985c2e38e64374a1beab3421b31693` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.651409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a17186-d595-42dc-8c35-34955bfd74ba None admin] RBAC: Authorizing `identity:get_user(user_id=ea985c2e38e64374a1beab3421b31693)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:29.652911 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a17186-d595-42dc-8c35-34955bfd74ba None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:29.655079 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 110/219] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:29 2022] GET /identity/v3/users/ea985c2e38e64374a1beab3421b31693 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:29.660745 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a48f30-0abf-4f95-927c-d71e0b2430f4 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:29.693785 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3b95-b6d7-4a30-8583-a97dbc3bea73 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.694215 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3b95-b6d7-4a30-8583-a97dbc3bea73 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.694425 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3b95-b6d7-4a30-8583-a97dbc3bea73 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.696906 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 111/220] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:29.701233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632543ce-fdc1-4645-9f7b-f36f038a7c6e None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.701807 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632543ce-fdc1-4645-9f7b-f36f038a7c6e None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.701807 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632543ce-fdc1-4645-9f7b-f36f038a7c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.720311 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-632543ce-fdc1-4645-9f7b-f36f038a7c6e None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:29.721523 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-632543ce-fdc1-4645-9f7b-f36f038a7c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:29.790432 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a48f30-0abf-4f95-927c-d71e0b2430f4 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:29.802431 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 112/221] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:29.827040 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632543ce-fdc1-4645-9f7b-f36f038a7c6e None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:29.836660 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274583f-3f51-421c-acf8-11105ef2456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:29.837288 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274583f-3f51-421c-acf8-11105ef2456e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.837527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274583f-3f51-421c-acf8-11105ef2456e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.837856 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274583f-3f51-421c-acf8-11105ef2456e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.901361 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:29.933362 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:29.936216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274583f-3f51-421c-acf8-11105ef2456e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:29.937887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274583f-3f51-421c-acf8-11105ef2456e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:29.964819 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632543ce-fdc1-4645-9f7b-f36f038a7c6e None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:30.011466 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26637798-c613-477f-97f6-765a9da2724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:30.012208 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637798-c613-477f-97f6-765a9da2724c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:30.012758 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637798-c613-477f-97f6-765a9da2724c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:30.013026 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637798-c613-477f-97f6-765a9da2724c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:30.027164 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26637798-c613-477f-97f6-765a9da2724c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-26637798-c613-477f-97f6-765a9da2724c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:30.033527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:30.034446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:30.035247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 113/222] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:23:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:23:30.041492 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26637798-c613-477f-97f6-765a9da2724c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:30.050959 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 110/223] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:30.060117 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274583f-3f51-421c-acf8-11105ef2456e None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:30.222667 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26637798-c613-477f-97f6-765a9da2724c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:30.235005 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:30.244189 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:30.250407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274583f-3f51-421c-acf8-11105ef2456e None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:30.262879 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844fa21-9a4c-4159-866e-6331c5fe0338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:30.263625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fa21-9a4c-4159-866e-6331c5fe0338 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:30.263742 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fa21-9a4c-4159-866e-6331c5fe0338 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:30.264050 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fa21-9a4c-4159-866e-6331c5fe0338 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:30.264787 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844fa21-9a4c-4159-866e-6331c5fe0338 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:30.265018 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844fa21-9a4c-4159-866e-6331c5fe0338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:30.266495 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844fa21-9a4c-4159-866e-6331c5fe0338 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:30.275446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 114/224] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:30.276342 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844fa21-9a4c-4159-866e-6331c5fe0338 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:30.298297 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670970c-1542-40a4-a22d-8773b2497e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:30.299275 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670970c-1542-40a4-a22d-8773b2497e34 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:30.299726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670970c-1542-40a4-a22d-8773b2497e34 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:30.300165 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670970c-1542-40a4-a22d-8773b2497e34 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:30.301911 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670970c-1542-40a4-a22d-8773b2497e34 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:30.303528 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670970c-1542-40a4-a22d-8773b2497e34 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:30.305397 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 111/225] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:30 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:30.310039 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670970c-1542-40a4-a22d-8773b2497e34 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:30.384971 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844fa21-9a4c-4159-866e-6331c5fe0338 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:30.419598 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670970c-1542-40a4-a22d-8773b2497e34 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:30.421200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea65ab-b540-432b-a752-be08fdfc3d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:30.422068 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea65ab-b540-432b-a752-be08fdfc3d94 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:30.422475 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea65ab-b540-432b-a752-be08fdfc3d94 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:30.422568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea65ab-b540-432b-a752-be08fdfc3d94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:30.433659 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea65ab-b540-432b-a752-be08fdfc3d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-f3ea65ab-b540-432b-a752-be08fdfc3d94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:30.439329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:30.440403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:30.441404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:30.442401 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 115/226] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:23:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:30.443731 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea65ab-b540-432b-a752-be08fdfc3d94 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:30.468625 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb688fa-b370-4e9d-b8ff-ba6ec9c76766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:30.469473 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb688fa-b370-4e9d-b8ff-ba6ec9c76766 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:30.469841 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb688fa-b370-4e9d-b8ff-ba6ec9c76766 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:30.470244 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb688fa-b370-4e9d-b8ff-ba6ec9c76766 None admin] PATH_INFO: `/v3/users/b6e7fac37b8c48b0a3c9a865704eddae` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:30.471585 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb688fa-b370-4e9d-b8ff-ba6ec9c76766 None admin] RBAC: Authorizing `identity:get_user(user_id=b6e7fac37b8c48b0a3c9a865704eddae)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:30.473232 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb688fa-b370-4e9d-b8ff-ba6ec9c76766 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:30.475425 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 112/227] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:30 2022] GET /identity/v3/users/b6e7fac37b8c48b0a3c9a865704eddae => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:30.476619 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb688fa-b370-4e9d-b8ff-ba6ec9c76766 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:30.483335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:30.515027 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:30.556657 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea65ab-b540-432b-a752-be08fdfc3d94 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:30.595165 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb688fa-b370-4e9d-b8ff-ba6ec9c76766 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:30.596249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dd1a8-0a54-49a4-b5c1-e37b288fbe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:30.597222 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dd1a8-0a54-49a4-b5c1-e37b288fbe41 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:30.598291 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dd1a8-0a54-49a4-b5c1-e37b288fbe41 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:30.598571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dd1a8-0a54-49a4-b5c1-e37b288fbe41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:30.599318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3dd1a8-0a54-49a4-b5c1-e37b288fbe41 None admin] RBAC: Adding query filter params (role.id=848a48b503dc483fbbc428affa473937, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60, user.id=ea985c2e38e64374a1beab3421b31693) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:30.599626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3dd1a8-0a54-49a4-b5c1-e37b288fbe41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:30.601090 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3dd1a8-0a54-49a4-b5c1-e37b288fbe41 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:30.608272 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 116/228] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:30 2022] GET /identity/v3/role_assignments?user.id=ea985c2e38e64374a1beab3421b31693&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=848a48b503dc483fbbc428affa473937 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:30.614810 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dd1a8-0a54-49a4-b5c1-e37b288fbe41 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:30.674660 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daa245-c702-40b2-b6a5-3541382a4fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:30.676232 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daa245-c702-40b2-b6a5-3541382a4fe5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:30.676511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daa245-c702-40b2-b6a5-3541382a4fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:30.676784 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daa245-c702-40b2-b6a5-3541382a4fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:30.677475 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4daa245-c702-40b2-b6a5-3541382a4fe5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:30.677786 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4daa245-c702-40b2-b6a5-3541382a4fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:30.679266 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4daa245-c702-40b2-b6a5-3541382a4fe5 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:30.703351 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 113/229] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:23:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:30.709418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daa245-c702-40b2-b6a5-3541382a4fe5 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:30.759825 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:30.768283 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dd1a8-0a54-49a4-b5c1-e37b288fbe41 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:30.815541 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b5bdd-4a30-454b-8ba8-15876811d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:30.816676 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b5bdd-4a30-454b-8ba8-15876811d322 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:30.817214 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b5bdd-4a30-454b-8ba8-15876811d322 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:30.817680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b5bdd-4a30-454b-8ba8-15876811d322 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:30.819926 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b5bdd-4a30-454b-8ba8-15876811d322 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:30.821692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b5bdd-4a30-454b-8ba8-15876811d322 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:30.824226 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 117/230] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:30 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:30.831021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b5bdd-4a30-454b-8ba8-15876811d322 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:30.899795 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:30.909774 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daa245-c702-40b2-b6a5-3541382a4fe5 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:30.947514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655bf99-b127-46fa-a2d8-c2e6d3f0d914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:30.948159 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655bf99-b127-46fa-a2d8-c2e6d3f0d914 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:30.948434 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655bf99-b127-46fa-a2d8-c2e6d3f0d914 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:30.948703 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655bf99-b127-46fa-a2d8-c2e6d3f0d914 None admin] PATH_INFO: `/v3/users/b6e7fac37b8c48b0a3c9a865704eddae` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:30.949861 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655bf99-b127-46fa-a2d8-c2e6d3f0d914 None admin] RBAC: Authorizing `identity:get_user(user_id=b6e7fac37b8c48b0a3c9a865704eddae)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:30.951368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655bf99-b127-46fa-a2d8-c2e6d3f0d914 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:30.953972 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 114/231] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:30 2022] GET /identity/v3/users/b6e7fac37b8c48b0a3c9a865704eddae => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:30.959476 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655bf99-b127-46fa-a2d8-c2e6d3f0d914 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:30.978797 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b5bdd-4a30-454b-8ba8-15876811d322 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:31.026726 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0ee6c-9db0-4948-ad4d-3b78bc8e0d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:31.027760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0ee6c-9db0-4948-ad4d-3b78bc8e0d5a None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:31.028261 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0ee6c-9db0-4948-ad4d-3b78bc8e0d5a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:31.028727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0ee6c-9db0-4948-ad4d-3b78bc8e0d5a None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/users/b6e7fac37b8c48b0a3c9a865704eddae/roles/4ef4b944934e44a28a394ebd1a816f64` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:31.035374 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0ee6c-9db0-4948-ad4d-3b78bc8e0d5a None admin] RBAC: Authorizing `identity:create_grant(project_id=80ecaf0386c44de0a3d32d38fec6ea60, user_id=b6e7fac37b8c48b0a3c9a865704eddae, role_id=4ef4b944934e44a28a394ebd1a816f64)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:31.037117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0ee6c-9db0-4948-ad4d-3b78bc8e0d5a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:31.068504 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 118/232] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:23:30 2022] PUT /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/users/b6e7fac37b8c48b0a3c9a865704eddae/roles/4ef4b944934e44a28a394ebd1a816f64 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:31.092796 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655bf99-b127-46fa-a2d8-c2e6d3f0d914 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:31.134485 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4e329-8065-44d9-97c2-a5ea13131f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:31.135195 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e329-8065-44d9-97c2-a5ea13131f77 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:31.135473 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e329-8065-44d9-97c2-a5ea13131f77 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:31.135741 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e329-8065-44d9-97c2-a5ea13131f77 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:31.136904 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4e329-8065-44d9-97c2-a5ea13131f77 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:31.138522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4e329-8065-44d9-97c2-a5ea13131f77 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:31.141289 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 115/233] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:30 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:31.147575 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0ee6c-9db0-4948-ad4d-3b78bc8e0d5a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:31.193596 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:31.281980 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0ee6c-9db0-4948-ad4d-3b78bc8e0d5a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:31.319167 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78ca95-1c6a-49b8-a6aa-68651cff71cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:31.319842 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78ca95-1c6a-49b8-a6aa-68651cff71cf None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:31.320118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78ca95-1c6a-49b8-a6aa-68651cff71cf None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:31.320453 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78ca95-1c6a-49b8-a6aa-68651cff71cf None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/users/b6e7fac37b8c48b0a3c9a865704eddae/roles/cee2b2731e93403d9f425e05f6905b53` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:31.322642 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78ca95-1c6a-49b8-a6aa-68651cff71cf None admin] RBAC: Authorizing `identity:create_grant(project_id=80ecaf0386c44de0a3d32d38fec6ea60, user_id=b6e7fac37b8c48b0a3c9a865704eddae, role_id=cee2b2731e93403d9f425e05f6905b53)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:31.324121 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78ca95-1c6a-49b8-a6aa-68651cff71cf None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:31.347714 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 119/234] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:23:31 2022] PUT /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/users/b6e7fac37b8c48b0a3c9a865704eddae/roles/cee2b2731e93403d9f425e05f6905b53 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:32.114696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c1a0-9789-400e-9ade-98af9e40cdcd None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:32.115264 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c1a0-9789-400e-9ade-98af9e40cdcd None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:32.115264 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c1a0-9789-400e-9ade-98af9e40cdcd None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:32.116718 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 116/235] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:32.130974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843edaf1-d58e-45e9-8c37-94a173e88208 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:32.131452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843edaf1-d58e-45e9-8c37-94a173e88208 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:32.131553 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843edaf1-d58e-45e9-8c37-94a173e88208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:32.156203 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-843edaf1-d58e-45e9-8c37-94a173e88208 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:32.157458 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-843edaf1-d58e-45e9-8c37-94a173e88208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:32.253379 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 120/236] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:32.479405 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad1e0-4bf0-43e8-900a-1929dd416af7 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:32.480054 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad1e0-4bf0-43e8-900a-1929dd416af7 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:32.480527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad1e0-4bf0-43e8-900a-1929dd416af7 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:32.482102 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 117/237] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:32.487442 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66732-7690-44eb-ba7f-4a13a1fd4311 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:32.487722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66732-7690-44eb-ba7f-4a13a1fd4311 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:32.487991 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66732-7690-44eb-ba7f-4a13a1fd4311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:32.510874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-6ba66732-7690-44eb-ba7f-4a13a1fd4311 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:32.512058 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-6ba66732-7690-44eb-ba7f-4a13a1fd4311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:32.526448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:32.615190 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 121/238] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:32.708393 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ad1e0-4bf0-43e8-900a-1929dd416af7 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:32.748231 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:32.844773 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ad1e0-4bf0-43e8-900a-1929dd416af7 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:32.894836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8b8dd-7dd9-4409-901a-515d748288ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:32.895491 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b8dd-7dd9-4409-901a-515d748288ee None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:32.895778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b8dd-7dd9-4409-901a-515d748288ee None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:32.896047 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b8dd-7dd9-4409-901a-515d748288ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:32.915973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8b8dd-7dd9-4409-901a-515d748288ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-53f8b8dd-7dd9-4409-901a-515d748288ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:32.921414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:32.922334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:32.923113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 118/239] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:32.930212 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba66732-7690-44eb-ba7f-4a13a1fd4311 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:33.005941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8b8dd-7dd9-4409-901a-515d748288ee None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:33.131244 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba66732-7690-44eb-ba7f-4a13a1fd4311 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:33.188134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:33.205308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8b8dd-7dd9-4409-901a-515d748288ee None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:33.219187 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf17eb4-ceed-4ebf-b606-197c0ca04fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:33.219856 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf17eb4-ceed-4ebf-b606-197c0ca04fe4 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:33.220136 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf17eb4-ceed-4ebf-b606-197c0ca04fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:33.220405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf17eb4-ceed-4ebf-b606-197c0ca04fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:33.221078 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf17eb4-ceed-4ebf-b606-197c0ca04fe4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:33.221375 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf17eb4-ceed-4ebf-b606-197c0ca04fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:33.222795 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf17eb4-ceed-4ebf-b606-197c0ca04fe4 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:33.244540 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 122/240] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:33.251095 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf17eb4-ceed-4ebf-b606-197c0ca04fe4 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:33.263400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:33.268775 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302412d-3081-468e-89c7-66b2a017994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:33.269437 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302412d-3081-468e-89c7-66b2a017994b None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:33.269926 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302412d-3081-468e-89c7-66b2a017994b None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:33.270060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302412d-3081-468e-89c7-66b2a017994b None admin] PATH_INFO: `/v3/domains/default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:33.272695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302412d-3081-468e-89c7-66b2a017994b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:33.274200 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302412d-3081-468e-89c7-66b2a017994b None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:33.276022 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 119/241] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:33.281843 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302412d-3081-468e-89c7-66b2a017994b None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:33.372186 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf17eb4-ceed-4ebf-b606-197c0ca04fe4 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:33.412173 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73777dd-9354-472c-9604-da5022a12bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:33.413143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73777dd-9354-472c-9604-da5022a12bdd None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:33.416664 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73777dd-9354-472c-9604-da5022a12bdd None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:33.417100 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73777dd-9354-472c-9604-da5022a12bdd None admin] PATH_INFO: `/v3/users/5a80d463a0384a3cbb1bfca9f8fcdbec` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:33.441672 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73777dd-9354-472c-9604-da5022a12bdd None admin] RBAC: Authorizing `identity:get_user(user_id=5a80d463a0384a3cbb1bfca9f8fcdbec)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:33.445911 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73777dd-9354-472c-9604-da5022a12bdd None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:33.448164 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 123/242] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:33 2022] GET /identity/v3/users/5a80d463a0384a3cbb1bfca9f8fcdbec => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:33.454814 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73777dd-9354-472c-9604-da5022a12bdd None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:33.504675 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302412d-3081-468e-89c7-66b2a017994b None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:33.536016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:33.547960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5e96-8eaa-4978-b05d-998add45fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:33.548587 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5e96-8eaa-4978-b05d-998add45fb21 None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:33.548872 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5e96-8eaa-4978-b05d-998add45fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:33.549143 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5e96-8eaa-4978-b05d-998add45fb21 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:33.549804 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5e96-8eaa-4978-b05d-998add45fb21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:33.551867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5e96-8eaa-4978-b05d-998add45fb21 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:33.581925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 120/243] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:23:33 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:23:33.583556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21146dc-5747-42a1-8ac9-d20684826314 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:33.583850 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21146dc-5747-42a1-8ac9-d20684826314 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:33.583959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73777dd-9354-472c-9604-da5022a12bdd None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:33.584125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21146dc-5747-42a1-8ac9-d20684826314 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:33.586039 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 121/244] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:33.592543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44106c-ba89-472d-9178-ccbe7abbda36 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:33.592917 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44106c-ba89-472d-9178-ccbe7abbda36 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:33.593241 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44106c-ba89-472d-9178-ccbe7abbda36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:33.619812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-ae44106c-ba89-472d-9178-ccbe7abbda36 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:33.621147 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-ae44106c-ba89-472d-9178-ccbe7abbda36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:33.637828 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:33.646743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347cb2f-a960-4f69-a3e2-a572ebea3ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:33.647434 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347cb2f-a960-4f69-a3e2-a572ebea3ffc None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:33.647710 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347cb2f-a960-4f69-a3e2-a572ebea3ffc None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:33.647974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347cb2f-a960-4f69-a3e2-a572ebea3ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:33.714271 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 122/245] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:33.738518 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347cb2f-a960-4f69-a3e2-a572ebea3ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:33.740672 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347cb2f-a960-4f69-a3e2-a572ebea3ffc None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:33.810509 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:33.835424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd95b3-af6b-4d9e-b8d0-84c68c7c5438 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:33.835689 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd95b3-af6b-4d9e-b8d0-84c68c7c5438 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:33.835955 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd95b3-af6b-4d9e-b8d0-84c68c7c5438 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:33.837732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 123/246] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:33.847489 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81847e-d70c-4cea-be65-795a75302c91 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:33.847801 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81847e-d70c-4cea-be65-795a75302c91 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:33.848031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81847e-d70c-4cea-be65-795a75302c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:33.859660 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 124/247] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:33.868390 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347cb2f-a960-4f69-a3e2-a572ebea3ffc None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:33.873524 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-9a81847e-d70c-4cea-be65-795a75302c91 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:33.874803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-9a81847e-d70c-4cea-be65-795a75302c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:33.949306 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 124/248] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:34.007973 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347cb2f-a960-4f69-a3e2-a572ebea3ffc None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:34.042854 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fee5c-8842-423a-adb9-e0f68f0bcfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:34.043477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fee5c-8842-423a-adb9-e0f68f0bcfbb None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.043748 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fee5c-8842-423a-adb9-e0f68f0bcfbb None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.044054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fee5c-8842-423a-adb9-e0f68f0bcfbb None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.045223 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fee5c-8842-423a-adb9-e0f68f0bcfbb None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:34.046714 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fee5c-8842-423a-adb9-e0f68f0bcfbb None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:34.048356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 125/249] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:33 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:34.054383 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81847e-d70c-4cea-be65-795a75302c91 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:34.111586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fee5c-8842-423a-adb9-e0f68f0bcfbb None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:34.142360 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:34.154433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:34.185881 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81847e-d70c-4cea-be65-795a75302c91 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:34.233186 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f911ed9-e773-48be-a9ce-9a8091fe9e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:34.233891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f911ed9-e773-48be-a9ce-9a8091fe9e23 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.234232 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f911ed9-e773-48be-a9ce-9a8091fe9e23 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.234512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f911ed9-e773-48be-a9ce-9a8091fe9e23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.235269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f911ed9-e773-48be-a9ce-9a8091fe9e23 None admin] RBAC: Adding query filter params (role.id=eb7fb540254848549730933af8f59dcb, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60, user.id=5a80d463a0384a3cbb1bfca9f8fcdbec) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:34.235580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f911ed9-e773-48be-a9ce-9a8091fe9e23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:34.237090 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f911ed9-e773-48be-a9ce-9a8091fe9e23 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:34.246188 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 125/250] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:34 2022] GET /identity/v3/role_assignments?user.id=5a80d463a0384a3cbb1bfca9f8fcdbec&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=eb7fb540254848549730933af8f59dcb => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:34.273777 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fee5c-8842-423a-adb9-e0f68f0bcfbb None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:34.328460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f911ed9-e773-48be-a9ce-9a8091fe9e23 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:34.329926 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eabd0c-67d9-4c73-bc31-9bf333a5c677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:34.330643 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eabd0c-67d9-4c73-bc31-9bf333a5c677 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.330916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eabd0c-67d9-4c73-bc31-9bf333a5c677 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.331182 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eabd0c-67d9-4c73-bc31-9bf333a5c677 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.351589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eabd0c-67d9-4c73-bc31-9bf333a5c677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-b8eabd0c-67d9-4c73-bc31-9bf333a5c677 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:34.357514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:34.358722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:34.359524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 126/251] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:34.365017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eabd0c-67d9-4c73-bc31-9bf333a5c677 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:34.491099 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f911ed9-e773-48be-a9ce-9a8091fe9e23 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:34.507861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:34.519887 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eabd0c-67d9-4c73-bc31-9bf333a5c677 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:34.541470 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4834a-2c06-41e8-8ffd-88ca4651952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:34.542369 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4834a-2c06-41e8-8ffd-88ca4651952f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.543036 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4834a-2c06-41e8-8ffd-88ca4651952f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.543312 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4834a-2c06-41e8-8ffd-88ca4651952f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.555298 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:34.559489 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4834a-2c06-41e8-8ffd-88ca4651952f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-e9d4834a-2c06-41e8-8ffd-88ca4651952f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:34.564812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:34.565729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:34.566568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 126/252] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:34.567226 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6a250-2440-4353-8998-c48a882edb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:34.567226 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6a250-2440-4353-8998-c48a882edb39 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.567226 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6a250-2440-4353-8998-c48a882edb39 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.567436 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881be839-f14f-4005-bc05-a295a68408b2 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.567507 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6a250-2440-4353-8998-c48a882edb39 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.567570 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881be839-f14f-4005-bc05-a295a68408b2 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.568447 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881be839-f14f-4005-bc05-a295a68408b2 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.568608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6a250-2440-4353-8998-c48a882edb39 None admin] RBAC: Adding query filter params (name=member) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:34.568608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6a250-2440-4353-8998-c48a882edb39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:34.569293 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 127/253] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:34.574105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6a250-2440-4353-8998-c48a882edb39 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:34.579549 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 127/254] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:34.580134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e171ff7-0bb5-4938-bc2c-81d38eba8b13 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.580511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e171ff7-0bb5-4938-bc2c-81d38eba8b13 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.580745 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e171ff7-0bb5-4938-bc2c-81d38eba8b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.584975 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6a250-2440-4353-8998-c48a882edb39 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:34.599941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-4e171ff7-0bb5-4938-bc2c-81d38eba8b13 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:34.601197 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-4e171ff7-0bb5-4938-bc2c-81d38eba8b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:34.682319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 128/255] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:34.682851 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e171ff7-0bb5-4938-bc2c-81d38eba8b13 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:34.721742 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6a250-2440-4353-8998-c48a882edb39 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:34.767444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867957be-d48c-4c03-90f5-64052663d92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:34.768981 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867957be-d48c-4c03-90f5-64052663d92f None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.769267 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867957be-d48c-4c03-90f5-64052663d92f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.769542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867957be-d48c-4c03-90f5-64052663d92f None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.770251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867957be-d48c-4c03-90f5-64052663d92f None admin] RBAC: Adding query filter params (name=admin) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:34.770558 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867957be-d48c-4c03-90f5-64052663d92f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:34.771952 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867957be-d48c-4c03-90f5-64052663d92f None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:34.784163 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 128/256] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:34.789837 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867957be-d48c-4c03-90f5-64052663d92f None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:34.803045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e171ff7-0bb5-4938-bc2c-81d38eba8b13 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:34.809907 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:34.833812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:34.841456 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92706088-841a-4300-9fe8-4fdce71c5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:34.842239 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706088-841a-4300-9fe8-4fdce71c5044 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.842519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706088-841a-4300-9fe8-4fdce71c5044 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.842792 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706088-841a-4300-9fe8-4fdce71c5044 None admin] PATH_INFO: `/v3/users/ea985c2e38e64374a1beab3421b31693` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.843964 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92706088-841a-4300-9fe8-4fdce71c5044 None admin] RBAC: Authorizing `identity:get_user(user_id=ea985c2e38e64374a1beab3421b31693)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:34.845464 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92706088-841a-4300-9fe8-4fdce71c5044 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:34.847138 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 129/257] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:34 2022] GET /identity/v3/users/ea985c2e38e64374a1beab3421b31693 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:34.852716 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92706088-841a-4300-9fe8-4fdce71c5044 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:34.902701 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867957be-d48c-4c03-90f5-64052663d92f None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:34.939605 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca64e0-5948-46fd-a102-895c880ec415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:34.940477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca64e0-5948-46fd-a102-895c880ec415 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.940901 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca64e0-5948-46fd-a102-895c880ec415 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.941311 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca64e0-5948-46fd-a102-895c880ec415 None admin] PATH_INFO: `/v3/users/b6e7fac37b8c48b0a3c9a865704eddae` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.944355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca64e0-5948-46fd-a102-895c880ec415 None admin] RBAC: Authorizing `identity:get_user(user_id=b6e7fac37b8c48b0a3c9a865704eddae)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:34.946222 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca64e0-5948-46fd-a102-895c880ec415 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:34.948014 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 129/258] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:34 2022] GET /identity/v3/users/b6e7fac37b8c48b0a3c9a865704eddae => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:34.957244 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca64e0-5948-46fd-a102-895c880ec415 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:34.962038 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92706088-841a-4300-9fe8-4fdce71c5044 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:34.997291 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd738db-6742-4145-96ad-7d0b613d22e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:34.997934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd738db-6742-4145-96ad-7d0b613d22e5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.998308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd738db-6742-4145-96ad-7d0b613d22e5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.998583 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd738db-6742-4145-96ad-7d0b613d22e5 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.999728 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd738db-6742-4145-96ad-7d0b613d22e5 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:35.001212 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd738db-6742-4145-96ad-7d0b613d22e5 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:35.003236 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 130/259] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:34 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:35.009140 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd738db-6742-4145-96ad-7d0b613d22e5 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:35.051147 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:35.070554 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca64e0-5948-46fd-a102-895c880ec415 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:35.080650 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:35.107850 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311ac0-b80f-48c1-bd48-1ce1953216aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:35.108668 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311ac0-b80f-48c1-bd48-1ce1953216aa None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:35.108868 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311ac0-b80f-48c1-bd48-1ce1953216aa None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:35.109137 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311ac0-b80f-48c1-bd48-1ce1953216aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:35.119787 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd738db-6742-4145-96ad-7d0b613d22e5 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:35.159570 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ebf5b-6678-4c8f-a732-aebf5a88c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:35.160244 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ebf5b-6678-4c8f-a732-aebf5a88c418 None admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:35.160519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ebf5b-6678-4c8f-a732-aebf5a88c418 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:35.160792 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ebf5b-6678-4c8f-a732-aebf5a88c418 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/users/ea985c2e38e64374a1beab3421b31693/roles/848a48b503dc483fbbc428affa473937` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:35.164196 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ebf5b-6678-4c8f-a732-aebf5a88c418 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ecaf0386c44de0a3d32d38fec6ea60, user_id=ea985c2e38e64374a1beab3421b31693, role_id=848a48b503dc483fbbc428affa473937)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:35.165682 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ebf5b-6678-4c8f-a732-aebf5a88c418 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:35.182445 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 131/260] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:23:35 2022] PUT /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/users/ea985c2e38e64374a1beab3421b31693/roles/848a48b503dc483fbbc428affa473937 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:23:35.197257 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf311ac0-b80f-48c1-bd48-1ce1953216aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:35.199921 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf311ac0-b80f-48c1-bd48-1ce1953216aa None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:35.297329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:35.313487 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ebf5b-6678-4c8f-a732-aebf5a88c418 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:35.321599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 130/261] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:23:35.327326 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311ac0-b80f-48c1-bd48-1ce1953216aa None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:35.434020 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311ac0-b80f-48c1-bd48-1ce1953216aa None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:35.465474 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb37021-98f1-4497-82d7-b98ec5fd51f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:35.474029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37021-98f1-4497-82d7-b98ec5fd51f6 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:35.474029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37021-98f1-4497-82d7-b98ec5fd51f6 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:35.474029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37021-98f1-4497-82d7-b98ec5fd51f6 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:35.474029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb37021-98f1-4497-82d7-b98ec5fd51f6 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:35.474029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb37021-98f1-4497-82d7-b98ec5fd51f6 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:35.474029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 131/262] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:35 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:35.477455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb37021-98f1-4497-82d7-b98ec5fd51f6 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:35.492135 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ebf5b-6678-4c8f-a732-aebf5a88c418 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:35.532415 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:35.544378 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:35.553858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe581d3c-eeae-4aea-b2b7-8639bacced6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:35.554898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581d3c-eeae-4aea-b2b7-8639bacced6c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:35.555524 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581d3c-eeae-4aea-b2b7-8639bacced6c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:35.556013 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581d3c-eeae-4aea-b2b7-8639bacced6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:35.572292 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe581d3c-eeae-4aea-b2b7-8639bacced6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-fe581d3c-eeae-4aea-b2b7-8639bacced6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:35.578713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:35.579834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:35.580727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:35.583345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 132/263] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:23:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:35.591108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe581d3c-eeae-4aea-b2b7-8639bacced6c None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:35.596943 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb37021-98f1-4497-82d7-b98ec5fd51f6 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:35.634108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58a0c2-7d43-496d-a5a5-b22c3124ea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:35.634725 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a0c2-7d43-496d-a5a5-b22c3124ea7d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:35.635001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a0c2-7d43-496d-a5a5-b22c3124ea7d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:35.635269 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a0c2-7d43-496d-a5a5-b22c3124ea7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:35.636009 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58a0c2-7d43-496d-a5a5-b22c3124ea7d None admin] RBAC: Adding query filter params (role.id=4ef4b944934e44a28a394ebd1a816f64, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60, user.id=b6e7fac37b8c48b0a3c9a865704eddae) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:35.636289 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58a0c2-7d43-496d-a5a5-b22c3124ea7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:35.642014 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58a0c2-7d43-496d-a5a5-b22c3124ea7d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:35.646841 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 132/264] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:35 2022] GET /identity/v3/role_assignments?user.id=b6e7fac37b8c48b0a3c9a865704eddae&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:35.727807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe581d3c-eeae-4aea-b2b7-8639bacced6c None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:35.773787 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de2b6d-cd4e-4290-b600-ff94c92eee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:35.774838 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2b6d-cd4e-4290-b600-ff94c92eee95 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:35.775368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2b6d-cd4e-4290-b600-ff94c92eee95 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:35.775839 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2b6d-cd4e-4290-b600-ff94c92eee95 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:35.776718 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de2b6d-cd4e-4290-b600-ff94c92eee95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:35.777217 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de2b6d-cd4e-4290-b600-ff94c92eee95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:35.778898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de2b6d-cd4e-4290-b600-ff94c92eee95 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:35.793663 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 133/265] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:23:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:35.799990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58a0c2-7d43-496d-a5a5-b22c3124ea7d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:35.961362 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58a0c2-7d43-496d-a5a5-b22c3124ea7d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:35.983551 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:36.002561 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66df31-9c81-4ad9-821f-e729ba5531b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:36.003217 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66df31-9c81-4ad9-821f-e729ba5531b1 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:36.003496 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66df31-9c81-4ad9-821f-e729ba5531b1 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:36.003771 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66df31-9c81-4ad9-821f-e729ba5531b1 None admin] PATH_INFO: `/v3/users/b6e7fac37b8c48b0a3c9a865704eddae` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:36.004948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66df31-9c81-4ad9-821f-e729ba5531b1 None admin] RBAC: Authorizing `identity:get_user(user_id=b6e7fac37b8c48b0a3c9a865704eddae)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:36.006466 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66df31-9c81-4ad9-821f-e729ba5531b1 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:36.008514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 133/266] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:35 2022] GET /identity/v3/users/b6e7fac37b8c48b0a3c9a865704eddae => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:36.015275 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de2b6d-cd4e-4290-b600-ff94c92eee95 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:36.093546 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:36.151618 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de2b6d-cd4e-4290-b600-ff94c92eee95 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:36.191120 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657ca11-363b-48c2-96df-d5f58c2a705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:36.192509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657ca11-363b-48c2-96df-d5f58c2a705c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:36.193175 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657ca11-363b-48c2-96df-d5f58c2a705c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:36.193874 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657ca11-363b-48c2-96df-d5f58c2a705c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:36.270208 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657ca11-363b-48c2-96df-d5f58c2a705c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:36.271764 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657ca11-363b-48c2-96df-d5f58c2a705c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:36.322729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:36.379915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 134/267] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:36.385691 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66df31-9c81-4ad9-821f-e729ba5531b1 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:36.496164 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66df31-9c81-4ad9-821f-e729ba5531b1 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:36.531414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88b75b-575d-49b4-ad18-a41f021a6528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:36.531965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88b75b-575d-49b4-ad18-a41f021a6528 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:36.532241 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88b75b-575d-49b4-ad18-a41f021a6528 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:36.532510 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88b75b-575d-49b4-ad18-a41f021a6528 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:36.533628 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88b75b-575d-49b4-ad18-a41f021a6528 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:36.535134 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88b75b-575d-49b4-ad18-a41f021a6528 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:36.542073 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 134/268] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:36 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:36.543436 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657ca11-363b-48c2-96df-d5f58c2a705c None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:36.650475 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657ca11-363b-48c2-96df-d5f58c2a705c None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:36.688976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292f7d3-3a65-425e-bede-0d62a96d8fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:36.689610 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f7d3-3a65-425e-bede-0d62a96d8fa5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:36.689890 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f7d3-3a65-425e-bede-0d62a96d8fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:36.690190 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f7d3-3a65-425e-bede-0d62a96d8fa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:36.690912 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292f7d3-3a65-425e-bede-0d62a96d8fa5 None admin] RBAC: Adding query filter params (role.id=cee2b2731e93403d9f425e05f6905b53, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60, user.id=b6e7fac37b8c48b0a3c9a865704eddae) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:36.691214 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292f7d3-3a65-425e-bede-0d62a96d8fa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:36.692920 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292f7d3-3a65-425e-bede-0d62a96d8fa5 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:36.700033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 135/269] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:36 2022] GET /identity/v3/role_assignments?user.id=b6e7fac37b8c48b0a3c9a865704eddae&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=cee2b2731e93403d9f425e05f6905b53 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:37.296047 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e24fdd-2219-4700-8311-37a953c41fcb None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:37.296704 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e24fdd-2219-4700-8311-37a953c41fcb None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:37.297227 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e24fdd-2219-4700-8311-37a953c41fcb None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:37.298824 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 135/270] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:37.304447 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a984a-210f-419b-a462-14fe5d168d0a None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:37.304991 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a984a-210f-419b-a462-14fe5d168d0a None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:37.305455 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a984a-210f-419b-a462-14fe5d168d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:37.327195 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-8b4a984a-210f-419b-a462-14fe5d168d0a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:37.328449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-8b4a984a-210f-419b-a462-14fe5d168d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:37.339967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:37.423921 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 136/271] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:37.503365 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efa254-2082-4e6b-9a1e-c2fcfc8bb7dc None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:37.504345 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efa254-2082-4e6b-9a1e-c2fcfc8bb7dc None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:37.504835 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efa254-2082-4e6b-9a1e-c2fcfc8bb7dc None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:37.506866 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 136/272] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:37.512339 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e21b5-efab-4041-87e0-c91c2803b63e None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:37.512633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e21b5-efab-4041-87e0-c91c2803b63e None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:37.512888 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e21b5-efab-4041-87e0-c91c2803b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:37.533047 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-946e21b5-efab-4041-87e0-c91c2803b63e None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:37.534286 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-946e21b5-efab-4041-87e0-c91c2803b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:37.605507 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 137/273] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:37.663828 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17500d1-c90c-445f-a7cc-81e4946f8655 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:37.664152 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17500d1-c90c-445f-a7cc-81e4946f8655 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:37.664368 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17500d1-c90c-445f-a7cc-81e4946f8655 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:37.665762 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 137/274] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:37.671872 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed9f03-48be-4754-bf9d-a2b69f1717bf None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:37.672818 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed9f03-48be-4754-bf9d-a2b69f1717bf None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:37.673244 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed9f03-48be-4754-bf9d-a2b69f1717bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:37.697843 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-0aed9f03-48be-4754-bf9d-a2b69f1717bf None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:37.699451 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-0aed9f03-48be-4754-bf9d-a2b69f1717bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:37.771230 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 138/275] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:37.778117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17500d1-c90c-445f-a7cc-81e4946f8655 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:37.841034 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:37.899090 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17500d1-c90c-445f-a7cc-81e4946f8655 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:37.935402 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaaee7-6e0f-4e34-8a15-84224c44386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:37.936906 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaaee7-6e0f-4e34-8a15-84224c44386c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:37.937380 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaaee7-6e0f-4e34-8a15-84224c44386c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:37.937819 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaaee7-6e0f-4e34-8a15-84224c44386c None admin] PATH_INFO: `/v3/domains/default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:37.939225 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaaee7-6e0f-4e34-8a15-84224c44386c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:37.940964 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaaee7-6e0f-4e34-8a15-84224c44386c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:37.943094 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 138/276] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:37.948783 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed9f03-48be-4754-bf9d-a2b69f1717bf None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:37.952027 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:37.958684 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaaee7-6e0f-4e34-8a15-84224c44386c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:38.076333 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaaee7-6e0f-4e34-8a15-84224c44386c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:38.086665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed9f03-48be-4754-bf9d-a2b69f1717bf None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:38.099169 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:38.114987 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3001850-fc65-4db7-bd03-d03846709fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:38.115632 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001850-fc65-4db7-bd03-d03846709fa8 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:38.115946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001850-fc65-4db7-bd03-d03846709fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:38.116149 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001850-fc65-4db7-bd03-d03846709fa8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:38.125056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f25e8-203a-46a4-9b32-b73f3dfa1457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:38.125681 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f25e8-203a-46a4-9b32-b73f3dfa1457 None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:38.125953 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f25e8-203a-46a4-9b32-b73f3dfa1457 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:38.126242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f25e8-203a-46a4-9b32-b73f3dfa1457 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:38.126888 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f25e8-203a-46a4-9b32-b73f3dfa1457 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:38.126986 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3001850-fc65-4db7-bd03-d03846709fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:38.128340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f25e8-203a-46a4-9b32-b73f3dfa1457 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-f3001850-fc65-4db7-bd03-d03846709fa8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:38.132063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:38.132929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 139/277] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:23:38.139097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8c42-0cdf-46bf-a915-2b66d49242fe None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:38.139804 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8c42-0cdf-46bf-a915-2b66d49242fe None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:38.139804 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8c42-0cdf-46bf-a915-2b66d49242fe None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:38.139804 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 140/278] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:38.142437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d8c42-0cdf-46bf-a915-2b66d49242fe None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:38.156707 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 139/279] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:23:37 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:23:38.158031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ff04-7f0e-4b2e-804e-3b94a8714086 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:38.158321 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ff04-7f0e-4b2e-804e-3b94a8714086 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:38.158595 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ff04-7f0e-4b2e-804e-3b94a8714086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:38.177707 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-5dc9ff04-7f0e-4b2e-804e-3b94a8714086 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:38.178998 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-5dc9ff04-7f0e-4b2e-804e-3b94a8714086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:38.242154 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:38.260126 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 140/280] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:38.261428 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9ff04-7f0e-4b2e-804e-3b94a8714086 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:38.281826 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d8c42-0cdf-46bf-a915-2b66d49242fe None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:38.329408 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed3de4-c889-4102-a39c-1aad92ce57aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:38.331171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed3de4-c889-4102-a39c-1aad92ce57aa None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:38.332084 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed3de4-c889-4102-a39c-1aad92ce57aa None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:38.332847 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed3de4-c889-4102-a39c-1aad92ce57aa None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:38.333960 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed3de4-c889-4102-a39c-1aad92ce57aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:38.334478 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed3de4-c889-4102-a39c-1aad92ce57aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:38.336588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed3de4-c889-4102-a39c-1aad92ce57aa None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:38.353862 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 141/281] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:38.358442 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed3de4-c889-4102-a39c-1aad92ce57aa None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:38.393859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9ff04-7f0e-4b2e-804e-3b94a8714086 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:38.415576 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:38.445733 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2590ca-dbe3-4029-a2d7-9dd0d008586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:38.446449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2590ca-dbe3-4029-a2d7-9dd0d008586a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:38.447311 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2590ca-dbe3-4029-a2d7-9dd0d008586a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:38.447584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2590ca-dbe3-4029-a2d7-9dd0d008586a None admin] PATH_INFO: `/v3/roles/member` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:38.462709 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2590ca-dbe3-4029-a2d7-9dd0d008586a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-db2590ca-dbe3-4029-a2d7-9dd0d008586a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:38.469633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:38.470575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:38.471554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 141/282] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:38.478179 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2590ca-dbe3-4029-a2d7-9dd0d008586a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:38.492789 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed3de4-c889-4102-a39c-1aad92ce57aa None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:38.546494 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:38.548652 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb30ec-5212-49bc-8928-e6eb9ed69400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:38.548652 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb30ec-5212-49bc-8928-e6eb9ed69400 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:38.549542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb30ec-5212-49bc-8928-e6eb9ed69400 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:38.549542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb30ec-5212-49bc-8928-e6eb9ed69400 None admin] PATH_INFO: `/v3/users/5a80d463a0384a3cbb1bfca9f8fcdbec` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:38.551256 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb30ec-5212-49bc-8928-e6eb9ed69400 None admin] RBAC: Authorizing `identity:get_user(user_id=5a80d463a0384a3cbb1bfca9f8fcdbec)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:38.552532 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb30ec-5212-49bc-8928-e6eb9ed69400 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:38.555505 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 142/283] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:38 2022] GET /identity/v3/users/5a80d463a0384a3cbb1bfca9f8fcdbec => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:38.560379 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb30ec-5212-49bc-8928-e6eb9ed69400 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:38.613017 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2590ca-dbe3-4029-a2d7-9dd0d008586a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:38.655224 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821014d-2d21-4e2b-8768-9488a38d8542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:38.656407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821014d-2d21-4e2b-8768-9488a38d8542 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:38.656684 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821014d-2d21-4e2b-8768-9488a38d8542 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:38.656953 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821014d-2d21-4e2b-8768-9488a38d8542 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:38.657632 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821014d-2d21-4e2b-8768-9488a38d8542 None admin] RBAC: Adding query filter params (name=member) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:38.658078 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821014d-2d21-4e2b-8768-9488a38d8542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:38.659832 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821014d-2d21-4e2b-8768-9488a38d8542 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:38.676239 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 142/284] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:38.677110 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821014d-2d21-4e2b-8768-9488a38d8542 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:38.697171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb30ec-5212-49bc-8928-e6eb9ed69400 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:38.714746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:38.740724 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40a21c-9811-4040-b63b-456da787305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:38.741605 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40a21c-9811-4040-b63b-456da787305a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:38.742045 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40a21c-9811-4040-b63b-456da787305a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:38.742485 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40a21c-9811-4040-b63b-456da787305a None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:38.743752 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40a21c-9811-4040-b63b-456da787305a None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:38.745353 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40a21c-9811-4040-b63b-456da787305a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:38.747472 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 143/285] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:38 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:38.749101 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40a21c-9811-4040-b63b-456da787305a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:38.788899 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821014d-2d21-4e2b-8768-9488a38d8542 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:38.824261 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea0853-8631-4814-a454-ff817bd35fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:38.824899 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0853-8631-4814-a454-ff817bd35fe5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:38.825177 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0853-8631-4814-a454-ff817bd35fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:38.825442 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0853-8631-4814-a454-ff817bd35fe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:38.835858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea0853-8631-4814-a454-ff817bd35fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-90ea0853-8631-4814-a454-ff817bd35fe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:38.841834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:38.843372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 143/286] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:38.844157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea0853-8631-4814-a454-ff817bd35fe5 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:38.849730 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:38.888532 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40a21c-9811-4040-b63b-456da787305a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:38.927828 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e8a38-ee6b-4bc0-b091-a074b928608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:38.928592 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8a38-ee6b-4bc0-b091-a074b928608d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:38.928954 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8a38-ee6b-4bc0-b091-a074b928608d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:38.929311 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8a38-ee6b-4bc0-b091-a074b928608d None admin] PATH_INFO: `/v3/users/30ea5c3c270840c19fcbc7fbe3c07f87` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:38.943888 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e8a38-ee6b-4bc0-b091-a074b928608d None admin] RBAC: Authorizing `identity:get_user(user_id=30ea5c3c270840c19fcbc7fbe3c07f87)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:38.945480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e8a38-ee6b-4bc0-b091-a074b928608d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:38.947642 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 144/287] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:38 2022] GET /identity/v3/users/30ea5c3c270840c19fcbc7fbe3c07f87 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:38.948586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e8a38-ee6b-4bc0-b091-a074b928608d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:38.980942 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea0853-8631-4814-a454-ff817bd35fe5 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:38.987195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:39.032854 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae9f10-544b-4e35-852a-1964c6cef079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:39.033789 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae9f10-544b-4e35-852a-1964c6cef079 None admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:39.034651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae9f10-544b-4e35-852a-1964c6cef079 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:39.035097 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae9f10-544b-4e35-852a-1964c6cef079 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/users/5a80d463a0384a3cbb1bfca9f8fcdbec/roles/eb7fb540254848549730933af8f59dcb` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:39.037690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae9f10-544b-4e35-852a-1964c6cef079 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ecaf0386c44de0a3d32d38fec6ea60, user_id=5a80d463a0384a3cbb1bfca9f8fcdbec, role_id=eb7fb540254848549730933af8f59dcb)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:39.040038 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae9f10-544b-4e35-852a-1964c6cef079 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:39.058316 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e8a38-ee6b-4bc0-b091-a074b928608d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:39.060215 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 144/288] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:23:38 2022] PUT /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/users/5a80d463a0384a3cbb1bfca9f8fcdbec/roles/eb7fb540254848549730933af8f59dcb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:39.062843 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae9f10-544b-4e35-852a-1964c6cef079 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:39.099001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28e45e-609a-4bd4-814a-44b3d35ec66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:39.099807 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28e45e-609a-4bd4-814a-44b3d35ec66a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:39.100104 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28e45e-609a-4bd4-814a-44b3d35ec66a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:39.100370 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28e45e-609a-4bd4-814a-44b3d35ec66a None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:39.101044 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28e45e-609a-4bd4-814a-44b3d35ec66a None admin] RBAC: Adding query filter params (name=member) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:39.101362 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28e45e-609a-4bd4-814a-44b3d35ec66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:39.102864 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28e45e-609a-4bd4-814a-44b3d35ec66a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:39.113402 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:39.113596 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 145/289] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:39.125549 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28e45e-609a-4bd4-814a-44b3d35ec66a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:39.236008 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae9f10-544b-4e35-852a-1964c6cef079 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:39.287623 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a4782-a7ce-4285-88cd-46f18537f26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:39.288642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a4782-a7ce-4285-88cd-46f18537f26e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:39.289144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a4782-a7ce-4285-88cd-46f18537f26e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:39.289863 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a4782-a7ce-4285-88cd-46f18537f26e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:39.290681 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a4782-a7ce-4285-88cd-46f18537f26e None admin] RBAC: Adding query filter params (role.id=848a48b503dc483fbbc428affa473937, user.id=30ea5c3c270840c19fcbc7fbe3c07f87, scope.system=all) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:39.290997 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a4782-a7ce-4285-88cd-46f18537f26e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:39.293416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a4782-a7ce-4285-88cd-46f18537f26e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:39.302389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 145/290] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Aug 19 19:23:39 2022] GET /identity/v3/role_assignments?user.id=30ea5c3c270840c19fcbc7fbe3c07f87&scope.system=all&role.id=848a48b503dc483fbbc428affa473937 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:39.332368 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:39.337364 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28e45e-609a-4bd4-814a-44b3d35ec66a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:39.377451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8668568-518b-47b7-94a7-26b2afb98c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:39.378442 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668568-518b-47b7-94a7-26b2afb98c3c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:39.378885 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668568-518b-47b7-94a7-26b2afb98c3c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:39.379289 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668568-518b-47b7-94a7-26b2afb98c3c None admin] PATH_INFO: `/v3/users/ea985c2e38e64374a1beab3421b31693` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:39.380802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8668568-518b-47b7-94a7-26b2afb98c3c None admin] RBAC: Authorizing `identity:get_user(user_id=ea985c2e38e64374a1beab3421b31693)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:39.382529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8668568-518b-47b7-94a7-26b2afb98c3c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:39.384434 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 146/291] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:39 2022] GET /identity/v3/users/ea985c2e38e64374a1beab3421b31693 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:39.390360 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a4782-a7ce-4285-88cd-46f18537f26e None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:39.539481 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:39.547480 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a4782-a7ce-4285-88cd-46f18537f26e None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:39.584452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53552404-d61b-41dd-b454-45f9d24ba1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:39.585109 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53552404-d61b-41dd-b454-45f9d24ba1cc None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:39.585389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53552404-d61b-41dd-b454-45f9d24ba1cc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:39.585663 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53552404-d61b-41dd-b454-45f9d24ba1cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:39.657672 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53552404-d61b-41dd-b454-45f9d24ba1cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:39.659269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53552404-d61b-41dd-b454-45f9d24ba1cc None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:39.757728 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:39.771811 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 146/292] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:23:39.773399 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8668568-518b-47b7-94a7-26b2afb98c3c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:39.902805 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8668568-518b-47b7-94a7-26b2afb98c3c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:39.951298 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94663d-5fcc-4a9c-9f7c-d7960a9ef1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:39.951946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94663d-5fcc-4a9c-9f7c-d7960a9ef1d7 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:39.952226 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94663d-5fcc-4a9c-9f7c-d7960a9ef1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:39.952496 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94663d-5fcc-4a9c-9f7c-d7960a9ef1d7 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:39.953714 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94663d-5fcc-4a9c-9f7c-d7960a9ef1d7 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:39.955213 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94663d-5fcc-4a9c-9f7c-d7960a9ef1d7 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:39.957040 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 147/293] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:39 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:39.962984 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53552404-d61b-41dd-b454-45f9d24ba1cc None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:40.082113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53552404-d61b-41dd-b454-45f9d24ba1cc None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:40.117845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aec148-1017-473c-8e01-e3bb396d4535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:40.118518 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aec148-1017-473c-8e01-e3bb396d4535 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:40.118801 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aec148-1017-473c-8e01-e3bb396d4535 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:40.119113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aec148-1017-473c-8e01-e3bb396d4535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:40.119802 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aec148-1017-473c-8e01-e3bb396d4535 None admin] RBAC: Adding query filter params (role.id=848a48b503dc483fbbc428affa473937, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60, user.id=ea985c2e38e64374a1beab3421b31693) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:40.120111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aec148-1017-473c-8e01-e3bb396d4535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:40.121590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aec148-1017-473c-8e01-e3bb396d4535 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:40.134209 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 147/294] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:39 2022] GET /identity/v3/role_assignments?user.id=ea985c2e38e64374a1beab3421b31693&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=848a48b503dc483fbbc428affa473937 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:40.754529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0604-4265-422f-8e04-ddea79f3d83f None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:40.754854 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0604-4265-422f-8e04-ddea79f3d83f None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:40.755107 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0604-4265-422f-8e04-ddea79f3d83f None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:40.756732 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 148/295] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:40.763252 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3f93-5efa-4c80-b06c-7402d4b3f6ce None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:40.763779 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3f93-5efa-4c80-b06c-7402d4b3f6ce None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:40.764216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3f93-5efa-4c80-b06c-7402d4b3f6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:40.788461 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-4d9f3f93-5efa-4c80-b06c-7402d4b3f6ce None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:40.789679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-4d9f3f93-5efa-4c80-b06c-7402d4b3f6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:40.855827 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:40.870329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 148/296] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:41.067110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21cc03-3c3b-4c20-92ed-de3619d969c0 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.067644 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21cc03-3c3b-4c20-92ed-de3619d969c0 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.067644 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21cc03-3c3b-4c20-92ed-de3619d969c0 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:41.069274 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 149/297] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:41.074722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76235-85f4-4c87-a986-eeae1d50caa8 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.075013 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76235-85f4-4c87-a986-eeae1d50caa8 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.075289 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76235-85f4-4c87-a986-eeae1d50caa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:41.094658 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-77f76235-85f4-4c87-a986-eeae1d50caa8 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:41.095860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-77f76235-85f4-4c87-a986-eeae1d50caa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:41.164425 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 149/298] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:41.206083 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21cc03-3c3b-4c20-92ed-de3619d969c0 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:41.244053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:41.317513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21cc03-3c3b-4c20-92ed-de3619d969c0 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:41.351857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6967ed2-79a0-48d6-ba8c-ae07e6adbd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:41.352482 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6967ed2-79a0-48d6-ba8c-ae07e6adbd15 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.352749 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6967ed2-79a0-48d6-ba8c-ae07e6adbd15 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.353012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6967ed2-79a0-48d6-ba8c-ae07e6adbd15 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:41.365117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6967ed2-79a0-48d6-ba8c-ae07e6adbd15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-f6967ed2-79a0-48d6-ba8c-ae07e6adbd15 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:41.369851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:41.370801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:41.371585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 150/299] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:41.376896 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f76235-85f4-4c87-a986-eeae1d50caa8 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:41.484473 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f76235-85f4-4c87-a986-eeae1d50caa8 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:41.503836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:41.506117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6967ed2-79a0-48d6-ba8c-ae07e6adbd15 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:41.522638 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80201b1a-8fe4-407c-b2fa-3c2ab34e9d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:41.523265 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80201b1a-8fe4-407c-b2fa-3c2ab34e9d47 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.523541 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80201b1a-8fe4-407c-b2fa-3c2ab34e9d47 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.523810 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80201b1a-8fe4-407c-b2fa-3c2ab34e9d47 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:41.524481 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80201b1a-8fe4-407c-b2fa-3c2ab34e9d47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:41.524785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80201b1a-8fe4-407c-b2fa-3c2ab34e9d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:41.526315 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80201b1a-8fe4-407c-b2fa-3c2ab34e9d47 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:41.535326 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 150/300] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:41.547028 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80201b1a-8fe4-407c-b2fa-3c2ab34e9d47 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:41.615398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:41.622973 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6967ed2-79a0-48d6-ba8c-ae07e6adbd15 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:41.658580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40a04-0e6c-40cd-9748-dcdf3af6bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:41.659324 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40a04-0e6c-40cd-9748-dcdf3af6bc79 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.659965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40a04-0e6c-40cd-9748-dcdf3af6bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.659965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40a04-0e6c-40cd-9748-dcdf3af6bc79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:41.661126 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff40a04-0e6c-40cd-9748-dcdf3af6bc79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:41.662772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff40a04-0e6c-40cd-9748-dcdf3af6bc79 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:41.669837 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 151/301] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:41.670907 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40a04-0e6c-40cd-9748-dcdf3af6bc79 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:41.691526 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80201b1a-8fe4-407c-b2fa-3c2ab34e9d47 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:41.731189 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36382a57-c66b-4417-90bc-4fc0c46d416b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:41.731922 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36382a57-c66b-4417-90bc-4fc0c46d416b None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.732266 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36382a57-c66b-4417-90bc-4fc0c46d416b None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.732634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36382a57-c66b-4417-90bc-4fc0c46d416b None admin] PATH_INFO: `/v3/users/ea7c898add9844e8bd2e425459d53458` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:41.748854 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36382a57-c66b-4417-90bc-4fc0c46d416b None admin] RBAC: Authorizing `identity:get_user(user_id=ea7c898add9844e8bd2e425459d53458)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:41.751981 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36382a57-c66b-4417-90bc-4fc0c46d416b None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:41.753490 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 151/302] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:41 2022] GET /identity/v3/users/ea7c898add9844e8bd2e425459d53458 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:41.754825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630141-b31a-4819-8f02-9e946145b6e3 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.755216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630141-b31a-4819-8f02-9e946145b6e3 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.755502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630141-b31a-4819-8f02-9e946145b6e3 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:41.758364 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 152/303] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:41.763812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630141-b31a-4819-8f02-9e946145b6e3 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:41.801362 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40a04-0e6c-40cd-9748-dcdf3af6bc79 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:41.817546 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:41.840774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28afe1-1502-4008-a0b9-d24b7150374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:41.841393 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28afe1-1502-4008-a0b9-d24b7150374a None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.841669 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28afe1-1502-4008-a0b9-d24b7150374a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28afe1-1502-4008-a0b9-d24b7150374a None admin] PATH_INFO: `/v3/groups` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:41.842594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28afe1-1502-4008-a0b9-d24b7150374a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:41.844029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28afe1-1502-4008-a0b9-d24b7150374a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:41.866146 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 152/304] 10.222.0.60 () {60 vars in 1134 bytes} [Fri Aug 19 19:23:41 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:23:41.866146 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf644e-b1f1-44ac-aa5b-9e90d51f5f1c None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.866146 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf644e-b1f1-44ac-aa5b-9e90d51f5f1c None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.866146 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf644e-b1f1-44ac-aa5b-9e90d51f5f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:41.886926 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-2abf644e-b1f1-44ac-aa5b-9e90d51f5f1c None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:41.888605 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-2abf644e-b1f1-44ac-aa5b-9e90d51f5f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:41.899536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630141-b31a-4819-8f02-9e946145b6e3 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:41.909652 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:41.949864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd53947-c432-4b70-b3b9-3e6dbbaaa3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:41.950692 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd53947-c432-4b70-b3b9-3e6dbbaaa3c0 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.951141 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd53947-c432-4b70-b3b9-3e6dbbaaa3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.951545 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd53947-c432-4b70-b3b9-3e6dbbaaa3c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:41.952574 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd53947-c432-4b70-b3b9-3e6dbbaaa3c0 None admin] RBAC: Adding query filter params (role.id=eb7fb540254848549730933af8f59dcb, user.id=ea7c898add9844e8bd2e425459d53458, scope.system=all) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:41.952988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd53947-c432-4b70-b3b9-3e6dbbaaa3c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:41.954788 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd53947-c432-4b70-b3b9-3e6dbbaaa3c0 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:41.968799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 153/305] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Aug 19 19:23:41 2022] GET /identity/v3/role_assignments?user.id=ea7c898add9844e8bd2e425459d53458&scope.system=all&role.id=eb7fb540254848549730933af8f59dcb => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:41.971007 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b3e6-99d6-4674-89a2-a10004c52cc1 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.971453 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b3e6-99d6-4674-89a2-a10004c52cc1 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.971828 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b3e6-99d6-4674-89a2-a10004c52cc1 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:41.973379 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 154/306] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:41.973614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 153/307] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:41.983496 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d6201-7ee3-460a-9ef7-593d7b02481e None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:41.983496 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d6201-7ee3-460a-9ef7-593d7b02481e None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:41.983496 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d6201-7ee3-460a-9ef7-593d7b02481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:42.005005 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-f38d6201-7ee3-460a-9ef7-593d7b02481e None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:42.006476 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-f38d6201-7ee3-460a-9ef7-593d7b02481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:42.098991 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 155/308] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:42.346597 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf644e-b1f1-44ac-aa5b-9e90d51f5f1c None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:42.436553 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d6201-7ee3-460a-9ef7-593d7b02481e None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:42.453652 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf644e-b1f1-44ac-aa5b-9e90d51f5f1c None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:42.471891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:42.493479 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b92fe3-669f-474f-be50-cc981a802018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:42.494021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b92fe3-669f-474f-be50-cc981a802018 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:42.494322 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b92fe3-669f-474f-be50-cc981a802018 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:42.494591 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b92fe3-669f-474f-be50-cc981a802018 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:42.505905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b92fe3-669f-474f-be50-cc981a802018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-b9b92fe3-669f-474f-be50-cc981a802018 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:42.510905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:42.511972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:42.513054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 154/309] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:42.520287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b92fe3-669f-474f-be50-cc981a802018 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:42.537034 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:42.557436 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d6201-7ee3-460a-9ef7-593d7b02481e None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:42.593169 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7330dce-56d5-413e-b023-839ffb59af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:42.594130 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7330dce-56d5-413e-b023-839ffb59af1d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:42.594588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7330dce-56d5-413e-b023-839ffb59af1d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:42.595021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7330dce-56d5-413e-b023-839ffb59af1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:42.605875 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7330dce-56d5-413e-b023-839ffb59af1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-b7330dce-56d5-413e-b023-839ffb59af1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:42.611042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:42.611934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:42.612732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:42.615160 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 156/310] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:42.620781 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7330dce-56d5-413e-b023-839ffb59af1d None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:42.635353 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b92fe3-669f-474f-be50-cc981a802018 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:42.673114 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336671e4-1f92-4340-8efc-4c6b2b80eff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:42.674119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336671e4-1f92-4340-8efc-4c6b2b80eff5 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:42.674691 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336671e4-1f92-4340-8efc-4c6b2b80eff5 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:42.675137 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336671e4-1f92-4340-8efc-4c6b2b80eff5 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:42.676072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336671e4-1f92-4340-8efc-4c6b2b80eff5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:42.676561 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336671e4-1f92-4340-8efc-4c6b2b80eff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:42.678246 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336671e4-1f92-4340-8efc-4c6b2b80eff5 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:42.692737 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 155/311] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:42.694480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336671e4-1f92-4340-8efc-4c6b2b80eff5 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:42.722502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:42.732053 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7330dce-56d5-413e-b023-839ffb59af1d None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:42.768938 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cba509-d092-49e3-9a97-b074bf0ccd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:42.769918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba509-d092-49e3-9a97-b074bf0ccd24 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:42.769918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba509-d092-49e3-9a97-b074bf0ccd24 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:42.770380 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba509-d092-49e3-9a97-b074bf0ccd24 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:42.770754 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cba509-d092-49e3-9a97-b074bf0ccd24 None admin] RBAC: Adding query filter params (name=member) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:42.771060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cba509-d092-49e3-9a97-b074bf0ccd24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:42.772497 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cba509-d092-49e3-9a97-b074bf0ccd24 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:42.785955 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 157/312] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:42.786858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cba509-d092-49e3-9a97-b074bf0ccd24 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:42.848782 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:42.894146 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336671e4-1f92-4340-8efc-4c6b2b80eff5 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:42.894596 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cba509-d092-49e3-9a97-b074bf0ccd24 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:42.930842 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26e8de-982a-4f0a-8c7e-5df42ab05bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:42.931503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26e8de-982a-4f0a-8c7e-5df42ab05bcb None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:42.931780 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26e8de-982a-4f0a-8c7e-5df42ab05bcb None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:42.932227 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26e8de-982a-4f0a-8c7e-5df42ab05bcb None admin] PATH_INFO: `/v3/users/30ea5c3c270840c19fcbc7fbe3c07f87` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:42.933957 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26e8de-982a-4f0a-8c7e-5df42ab05bcb None admin] RBAC: Authorizing `identity:get_user(user_id=30ea5c3c270840c19fcbc7fbe3c07f87)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:42.934988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26e8de-982a-4f0a-8c7e-5df42ab05bcb None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:42.941426 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 158/313] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:42 2022] GET /identity/v3/users/30ea5c3c270840c19fcbc7fbe3c07f87 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:42.942242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26e8de-982a-4f0a-8c7e-5df42ab05bcb None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:42.955818 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47901d-197c-44e5-afc8-dc94faa6c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:42.957185 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47901d-197c-44e5-afc8-dc94faa6c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:42.957891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47901d-197c-44e5-afc8-dc94faa6c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:42.958761 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47901d-197c-44e5-afc8-dc94faa6c6d6 None admin] PATH_INFO: `/v3/users/5a80d463a0384a3cbb1bfca9f8fcdbec` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:42.961046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47901d-197c-44e5-afc8-dc94faa6c6d6 None admin] RBAC: Authorizing `identity:get_user(user_id=5a80d463a0384a3cbb1bfca9f8fcdbec)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:42.964368 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47901d-197c-44e5-afc8-dc94faa6c6d6 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:42.974239 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 156/314] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:42 2022] GET /identity/v3/users/5a80d463a0384a3cbb1bfca9f8fcdbec => generated 297 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:42.975031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:42.980235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47901d-197c-44e5-afc8-dc94faa6c6d6 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:43.048205 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26e8de-982a-4f0a-8c7e-5df42ab05bcb None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:43.084411 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339320d-167f-4690-95f1-453ec6d5fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:43.085405 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339320d-167f-4690-95f1-453ec6d5fca3 None admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:43.085858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339320d-167f-4690-95f1-453ec6d5fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:43.086376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339320d-167f-4690-95f1-453ec6d5fca3 None admin] PATH_INFO: `/v3/system/users/30ea5c3c270840c19fcbc7fbe3c07f87/roles/848a48b503dc483fbbc428affa473937` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:43.088144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339320d-167f-4690-95f1-453ec6d5fca3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=30ea5c3c270840c19fcbc7fbe3c07f87, role_id=848a48b503dc483fbbc428affa473937)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:43.089894 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339320d-167f-4690-95f1-453ec6d5fca3 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:43.102225 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 159/315] 10.222.0.60 () {58 vars in 1334 bytes} [Fri Aug 19 19:23:42 2022] PUT /identity/v3/system/users/30ea5c3c270840c19fcbc7fbe3c07f87/roles/848a48b503dc483fbbc428affa473937 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:43.161951 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47901d-197c-44e5-afc8-dc94faa6c6d6 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:43.202710 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee9e3f-b7de-4551-928d-fd4dfb9bf736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:43.203393 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee9e3f-b7de-4551-928d-fd4dfb9bf736 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:43.203665 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee9e3f-b7de-4551-928d-fd4dfb9bf736 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:43.203984 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee9e3f-b7de-4551-928d-fd4dfb9bf736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:43.218530 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:43.284019 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee9e3f-b7de-4551-928d-fd4dfb9bf736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:43.285503 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee9e3f-b7de-4551-928d-fd4dfb9bf736 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:43.396263 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 157/316] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:23:43.398224 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339320d-167f-4690-95f1-453ec6d5fca3 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:43.488724 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:43.505908 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339320d-167f-4690-95f1-453ec6d5fca3 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:43.540478 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27635-60fb-41d1-bd69-e0a81e635e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:43.541359 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27635-60fb-41d1-bd69-e0a81e635e0c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:43.541641 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27635-60fb-41d1-bd69-e0a81e635e0c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:43.541908 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27635-60fb-41d1-bd69-e0a81e635e0c None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:43.543142 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27635-60fb-41d1-bd69-e0a81e635e0c None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:43.544610 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27635-60fb-41d1-bd69-e0a81e635e0c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:43.546574 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 160/317] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:43 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:43.552449 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee9e3f-b7de-4551-928d-fd4dfb9bf736 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:43.597235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:43.659310 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee9e3f-b7de-4551-928d-fd4dfb9bf736 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:43.699035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188db81-39c0-43eb-b151-68bcd3fc3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:43.699983 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188db81-39c0-43eb-b151-68bcd3fc3b25 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:43.700446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188db81-39c0-43eb-b151-68bcd3fc3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:43.700887 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188db81-39c0-43eb-b151-68bcd3fc3b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:43.701851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188db81-39c0-43eb-b151-68bcd3fc3b25 None admin] RBAC: Adding query filter params (role.id=eb7fb540254848549730933af8f59dcb, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60, user.id=5a80d463a0384a3cbb1bfca9f8fcdbec) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:43.702369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188db81-39c0-43eb-b151-68bcd3fc3b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:43.704123 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188db81-39c0-43eb-b151-68bcd3fc3b25 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:43.711334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 158/318] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:23:43 2022] GET /identity/v3/role_assignments?user.id=5a80d463a0384a3cbb1bfca9f8fcdbec&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=eb7fb540254848549730933af8f59dcb => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:44.212351 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ca7c8-4929-4ebb-aeee-e44d1113f83c None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:44.212875 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ca7c8-4929-4ebb-aeee-e44d1113f83c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:44.212875 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ca7c8-4929-4ebb-aeee-e44d1113f83c None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:44.214734 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 161/319] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:44.219947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995ed6f-78d5-40ad-bbd0-3ad6325e1c00 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:44.220236 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995ed6f-78d5-40ad-bbd0-3ad6325e1c00 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:44.220507 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995ed6f-78d5-40ad-bbd0-3ad6325e1c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:44.238602 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-c995ed6f-78d5-40ad-bbd0-3ad6325e1c00 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:44.239791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-c995ed6f-78d5-40ad-bbd0-3ad6325e1c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:44.311111 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 159/320] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:44.353358 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b4e8-03f8-478d-91af-e8cd7dbdcbfc None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:44.353690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b4e8-03f8-478d-91af-e8cd7dbdcbfc None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:44.353877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b4e8-03f8-478d-91af-e8cd7dbdcbfc None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:44.355441 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 162/321] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:44.361082 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84c01f-a818-4504-b89c-145665134668 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:44.361342 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84c01f-a818-4504-b89c-145665134668 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:44.361633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84c01f-a818-4504-b89c-145665134668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:44.381549 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-3c84c01f-a818-4504-b89c-145665134668 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:44.382788 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-3c84c01f-a818-4504-b89c-145665134668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:44.414081 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:44.457228 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 160/322] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:44.629083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59b4e8-03f8-478d-91af-e8cd7dbdcbfc None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:44.735615 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59b4e8-03f8-478d-91af-e8cd7dbdcbfc None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:44.769609 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9a3dd-5134-487e-a1f3-f9e5816fa677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:44.770187 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9a3dd-5134-487e-a1f3-f9e5816fa677 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:44.770483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9a3dd-5134-487e-a1f3-f9e5816fa677 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:44.770751 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9a3dd-5134-487e-a1f3-f9e5816fa677 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:44.775131 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84c01f-a818-4504-b89c-145665134668 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:44.781761 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9a3dd-5134-487e-a1f3-f9e5816fa677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-29a9a3dd-5134-487e-a1f3-f9e5816fa677 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:44.787098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:44.788204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:44.789582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 163/323] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:44.794778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9a3dd-5134-487e-a1f3-f9e5816fa677 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:44.811955 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:44.890943 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84c01f-a818-4504-b89c-145665134668 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:44.900127 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9a3dd-5134-487e-a1f3-f9e5816fa677 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:44.925973 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c65020-a1db-4826-be45-a6ebb49175ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:44.926650 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c65020-a1db-4826-be45-a6ebb49175ad None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:44.926924 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c65020-a1db-4826-be45-a6ebb49175ad None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:44.927194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c65020-a1db-4826-be45-a6ebb49175ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:44.928299 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c65020-a1db-4826-be45-a6ebb49175ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:44.929794 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c65020-a1db-4826-be45-a6ebb49175ad None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:44.931415 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 161/324] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:23:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:44.937166 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c65020-a1db-4826-be45-a6ebb49175ad None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:44.939610 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22db36-a1d7-4eb2-8c8a-924d8befab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:44.940234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22db36-a1d7-4eb2-8c8a-924d8befab6e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:44.940513 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22db36-a1d7-4eb2-8c8a-924d8befab6e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:44.940785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22db36-a1d7-4eb2-8c8a-924d8befab6e None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:44.941458 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22db36-a1d7-4eb2-8c8a-924d8befab6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:44.941760 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22db36-a1d7-4eb2-8c8a-924d8befab6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:44.943192 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22db36-a1d7-4eb2-8c8a-924d8befab6e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:44.952308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 164/325] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:44.957859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22db36-a1d7-4eb2-8c8a-924d8befab6e None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:44.972981 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:45.039944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:45.044881 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c65020-a1db-4826-be45-a6ebb49175ad None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:45.068354 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22db36-a1d7-4eb2-8c8a-924d8befab6e None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:45.083291 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33ebfd-b15e-4579-aa80-651dd6ff0eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:45.083900 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33ebfd-b15e-4579-aa80-651dd6ff0eb1 None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:45.084176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33ebfd-b15e-4579-aa80-651dd6ff0eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:45.084440 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33ebfd-b15e-4579-aa80-651dd6ff0eb1 None admin] PATH_INFO: `/v3/groups` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:45.085053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33ebfd-b15e-4579-aa80-651dd6ff0eb1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:45.086529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33ebfd-b15e-4579-aa80-651dd6ff0eb1 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:45.103684 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 162/326] 10.222.0.60 () {60 vars in 1134 bytes} [Fri Aug 19 19:23:44 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:23:45.107241 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862038cf-ead8-4781-8f4c-de8b002d9b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:45.108100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862038cf-ead8-4781-8f4c-de8b002d9b55 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:45.108453 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862038cf-ead8-4781-8f4c-de8b002d9b55 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:45.108823 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862038cf-ead8-4781-8f4c-de8b002d9b55 None admin] PATH_INFO: `/v3/users/ea7c898add9844e8bd2e425459d53458` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:45.110127 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862038cf-ead8-4781-8f4c-de8b002d9b55 None admin] RBAC: Authorizing `identity:get_user(user_id=ea7c898add9844e8bd2e425459d53458)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:45.111796 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862038cf-ead8-4781-8f4c-de8b002d9b55 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:45.113814 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 165/327] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:44 2022] GET /identity/v3/users/ea7c898add9844e8bd2e425459d53458 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:45.119735 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33ebfd-b15e-4579-aa80-651dd6ff0eb1 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:45.240864 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:45.251697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33ebfd-b15e-4579-aa80-651dd6ff0eb1 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:45.294493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e1780-30d1-4141-b121-bb36a001949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:45.294493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e1780-30d1-4141-b121-bb36a001949d None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:45.294761 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e1780-30d1-4141-b121-bb36a001949d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:45.295067 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e1780-30d1-4141-b121-bb36a001949d None admin] PATH_INFO: `/v3/system/users/ea7c898add9844e8bd2e425459d53458/roles/eb7fb540254848549730933af8f59dcb` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:45.297503 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e1780-30d1-4141-b121-bb36a001949d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ea7c898add9844e8bd2e425459d53458, role_id=eb7fb540254848549730933af8f59dcb)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:45.298500 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e1780-30d1-4141-b121-bb36a001949d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:45.309053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 163/328] 10.222.0.60 () {58 vars in 1334 bytes} [Fri Aug 19 19:23:45 2022] PUT /identity/v3/system/users/ea7c898add9844e8bd2e425459d53458/roles/eb7fb540254848549730933af8f59dcb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:23:45.417266 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9c97-1025-4270-a758-16348e00a9a7 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:45.417786 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9c97-1025-4270-a758-16348e00a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:45.418091 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9c97-1025-4270-a758-16348e00a9a7 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:45.420723 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 166/329] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:45.428660 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9cd62-c40a-4824-b905-ed7cb9bae516 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:45.429185 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9cd62-c40a-4824-b905-ed7cb9bae516 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:45.429185 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9cd62-c40a-4824-b905-ed7cb9bae516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:45.451586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-d4b9cd62-c40a-4824-b905-ed7cb9bae516 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:45.452940 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-d4b9cd62-c40a-4824-b905-ed7cb9bae516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:45.534123 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 164/330] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:45.864781 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f9c97-1025-4270-a758-16348e00a9a7 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:45.977934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f9c97-1025-4270-a758-16348e00a9a7 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:46.017874 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baafbe-e22a-4aa3-b327-0a442735dfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:46.018547 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baafbe-e22a-4aa3-b327-0a442735dfa4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:46.018824 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baafbe-e22a-4aa3-b327-0a442735dfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:46.019097 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baafbe-e22a-4aa3-b327-0a442735dfa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:46.033830 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baafbe-e22a-4aa3-b327-0a442735dfa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-00baafbe-e22a-4aa3-b327-0a442735dfa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:46.039037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:46.039909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:46.040710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:46.046111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 167/331] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:46.049933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9cd62-c40a-4824-b905-ed7cb9bae516 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:46.150495 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:46.166883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9cd62-c40a-4824-b905-ed7cb9bae516 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:46.214862 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab47856-35dd-4e33-a33a-e766a9c3f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:46.215496 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab47856-35dd-4e33-a33a-e766a9c3f508 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:46.215768 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab47856-35dd-4e33-a33a-e766a9c3f508 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:46.216033 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab47856-35dd-4e33-a33a-e766a9c3f508 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:46.216830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab47856-35dd-4e33-a33a-e766a9c3f508 None admin] RBAC: Adding query filter params (name=member) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:46.217132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab47856-35dd-4e33-a33a-e766a9c3f508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:46.218557 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab47856-35dd-4e33-a33a-e766a9c3f508 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:46.228549 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 165/332] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:46.234500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baafbe-e22a-4aa3-b327-0a442735dfa4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:46.244098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:46.367985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baafbe-e22a-4aa3-b327-0a442735dfa4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:46.417935 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f4342-8dcc-4828-8ab7-05ab1a22c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:46.418603 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f4342-8dcc-4828-8ab7-05ab1a22c333 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:46.418853 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f4342-8dcc-4828-8ab7-05ab1a22c333 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:46.419048 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f4342-8dcc-4828-8ab7-05ab1a22c333 None admin] PATH_INFO: `/v3/users/30ea5c3c270840c19fcbc7fbe3c07f87` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:46.420491 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f4342-8dcc-4828-8ab7-05ab1a22c333 None admin] RBAC: Authorizing `identity:get_user(user_id=30ea5c3c270840c19fcbc7fbe3c07f87)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:46.422666 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f4342-8dcc-4828-8ab7-05ab1a22c333 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:46.424281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 168/333] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:46 2022] GET /identity/v3/users/30ea5c3c270840c19fcbc7fbe3c07f87 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:46.430474 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab47856-35dd-4e33-a33a-e766a9c3f508 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:46.592521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab47856-35dd-4e33-a33a-e766a9c3f508 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:46.644689 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e85c68-5e5f-4081-96f3-87d5bec44aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:46.645526 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e85c68-5e5f-4081-96f3-87d5bec44aea None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:46.645803 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e85c68-5e5f-4081-96f3-87d5bec44aea None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:46.646094 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e85c68-5e5f-4081-96f3-87d5bec44aea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:46.646824 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e85c68-5e5f-4081-96f3-87d5bec44aea None admin] RBAC: Adding query filter params (role.id=848a48b503dc483fbbc428affa473937, user.id=30ea5c3c270840c19fcbc7fbe3c07f87, scope.system=all) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:46.647128 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e85c68-5e5f-4081-96f3-87d5bec44aea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:46.648599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e85c68-5e5f-4081-96f3-87d5bec44aea None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:46.670965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 166/334] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Aug 19 19:23:46 2022] GET /identity/v3/role_assignments?user.id=30ea5c3c270840c19fcbc7fbe3c07f87&scope.system=all&role.id=848a48b503dc483fbbc428affa473937 => generated 510 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:48.132822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e19ce2-b93c-487f-ad66-8dfc7b703381 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:48.133460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e19ce2-b93c-487f-ad66-8dfc7b703381 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:48.133460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e19ce2-b93c-487f-ad66-8dfc7b703381 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:48.134997 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 169/335] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:48.142905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78344-a795-4812-9adf-131b11256160 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:48.143417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78344-a795-4812-9adf-131b11256160 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:48.143417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78344-a795-4812-9adf-131b11256160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:48.167894 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-bdf78344-a795-4812-9adf-131b11256160 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:48.169113 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-bdf78344-a795-4812-9adf-131b11256160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:48.171524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:48.175177 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344fc23-8231-4e10-b41c-d8f0274c9ad5 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:48.175500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344fc23-8231-4e10-b41c-d8f0274c9ad5 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:48.175712 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344fc23-8231-4e10-b41c-d8f0274c9ad5 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:48.177294 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 170/336] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:48.182170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bff6b-a645-4d0c-adaa-77744af62e78 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:48.182444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bff6b-a645-4d0c-adaa-77744af62e78 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:48.183152 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bff6b-a645-4d0c-adaa-77744af62e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:48.225724 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-411bff6b-a645-4d0c-adaa-77744af62e78 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:48.229402 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-411bff6b-a645-4d0c-adaa-77744af62e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:48.300458 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 167/337] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:48.352187 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 171/338] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:48.651544 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84cab8-8ea2-437e-afea-68125d844fb6 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:48.651875 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84cab8-8ea2-437e-afea-68125d844fb6 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:48.652105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84cab8-8ea2-437e-afea-68125d844fb6 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:48.653598 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 168/339] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:48.671109 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ef228-8006-4a6a-98f9-8496d4c41a3a None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:48.671392 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ef228-8006-4a6a-98f9-8496d4c41a3a None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:48.671649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ef228-8006-4a6a-98f9-8496d4c41a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:48.683683 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:48.703197 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-822ef228-8006-4a6a-98f9-8496d4c41a3a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:48.704631 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-822ef228-8006-4a6a-98f9-8496d4c41a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:48.777436 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84cab8-8ea2-437e-afea-68125d844fb6 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:48.789312 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 172/340] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:48.841436 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480f613-ae04-4040-9c41-af7b786d7806 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:48.841783 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480f613-ae04-4040-9c41-af7b786d7806 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:48.842101 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480f613-ae04-4040-9c41-af7b786d7806 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:48.844646 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 173/341] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:48.856193 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96bdff-213e-4d43-84de-afcab3082d12 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:48.856499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96bdff-213e-4d43-84de-afcab3082d12 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:48.856725 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96bdff-213e-4d43-84de-afcab3082d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:48.883215 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-0b96bdff-213e-4d43-84de-afcab3082d12 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:48.884557 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-0b96bdff-213e-4d43-84de-afcab3082d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:48.975615 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 174/342] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:48.976490 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96bdff-213e-4d43-84de-afcab3082d12 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:48.979787 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84cab8-8ea2-437e-afea-68125d844fb6 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:49.034324 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82315e48-7b69-4e59-94a8-eb87d35ed6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:49.035100 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82315e48-7b69-4e59-94a8-eb87d35ed6b7 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.035373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82315e48-7b69-4e59-94a8-eb87d35ed6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.035635 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82315e48-7b69-4e59-94a8-eb87d35ed6b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.047686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:49.052103 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82315e48-7b69-4e59-94a8-eb87d35ed6b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-82315e48-7b69-4e59-94a8-eb87d35ed6b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:49.058143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:49.060321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:49.062398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 169/343] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:23:49.069602 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82315e48-7b69-4e59-94a8-eb87d35ed6b7 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:49.094490 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:49.188140 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96bdff-213e-4d43-84de-afcab3082d12 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:49.222536 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82315e48-7b69-4e59-94a8-eb87d35ed6b7 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:49.272847 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd9f00-fea8-4b81-9291-6d4e400d5c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:49.273456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd9f00-fea8-4b81-9291-6d4e400d5c80 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.273725 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd9f00-fea8-4b81-9291-6d4e400d5c80 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.274005 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd9f00-fea8-4b81-9291-6d4e400d5c80 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.274663 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd9f00-fea8-4b81-9291-6d4e400d5c80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:49.274956 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd9f00-fea8-4b81-9291-6d4e400d5c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:49.276327 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd9f00-fea8-4b81-9291-6d4e400d5c80 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:49.279676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a99aab-0afb-401c-bc1a-2334f72ee149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:49.280314 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a99aab-0afb-401c-bc1a-2334f72ee149 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.280581 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a99aab-0afb-401c-bc1a-2334f72ee149 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.280846 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a99aab-0afb-401c-bc1a-2334f72ee149 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.299658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 170/344] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:49.300364 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd9f00-fea8-4b81-9291-6d4e400d5c80 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:49.301587 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a99aab-0afb-401c-bc1a-2334f72ee149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-50a99aab-0afb-401c-bc1a-2334f72ee149 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:49.306416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:49.307313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:49.308128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 175/345] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:49.309903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a99aab-0afb-401c-bc1a-2334f72ee149 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:49.426114 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:49.512601 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd9f00-fea8-4b81-9291-6d4e400d5c80 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:49.522693 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a99aab-0afb-401c-bc1a-2334f72ee149 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:49.549522 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b49e88-56d4-4308-8f38-771268d741e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:49.550095 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49e88-56d4-4308-8f38-771268d741e5 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.550367 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49e88-56d4-4308-8f38-771268d741e5 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.550630 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49e88-56d4-4308-8f38-771268d741e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.557285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:49.570422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b49e88-56d4-4308-8f38-771268d741e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:49.575072 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d64f3-c681-41dc-9090-08923a60c20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:49.575725 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d64f3-c681-41dc-9090-08923a60c20b None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.576062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d64f3-c681-41dc-9090-08923a60c20b None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-24b49e88-56d4-4308-8f38-771268d741e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:49.576249 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:49.578381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:49.580414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:49.582010 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d64f3-c681-41dc-9090-08923a60c20b None admin] PATH_INFO: `/v3/users/ea7c898add9844e8bd2e425459d53458` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.582010 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d64f3-c681-41dc-9090-08923a60c20b None admin] RBAC: Authorizing `identity:get_user(user_id=ea7c898add9844e8bd2e425459d53458)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:49.582361 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 171/346] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:49.582361 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b49e88-56d4-4308-8f38-771268d741e5 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:49.582597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d64f3-c681-41dc-9090-08923a60c20b None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:49.582597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 176/347] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 19:23:49 2022] GET /identity/v3/users/ea7c898add9844e8bd2e425459d53458 => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:49.582597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d64f3-c681-41dc-9090-08923a60c20b None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:49.706971 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d64f3-c681-41dc-9090-08923a60c20b None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:49.715486 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b49e88-56d4-4308-8f38-771268d741e5 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:49.743657 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:49.748906 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661b4c5-f649-4da0-8317-3e2055a21802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:49.749558 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661b4c5-f649-4da0-8317-3e2055a21802 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.749831 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661b4c5-f649-4da0-8317-3e2055a21802 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.750133 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661b4c5-f649-4da0-8317-3e2055a21802 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.764613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661b4c5-f649-4da0-8317-3e2055a21802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:49.765242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98779da-b85d-4531-8a99-17d4830c93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:49.765956 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98779da-b85d-4531-8a99-17d4830c93a5 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.766408 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98779da-b85d-4531-8a99-17d4830c93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.766677 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98779da-b85d-4531-8a99-17d4830c93a5 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.767337 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98779da-b85d-4531-8a99-17d4830c93a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:49.767632 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98779da-b85d-4531-8a99-17d4830c93a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:49.769045 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98779da-b85d-4531-8a99-17d4830c93a5 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-a661b4c5-f649-4da0-8317-3e2055a21802 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:49.771025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:49.771887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:49.772676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 177/348] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:23:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:49.773353 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661b4c5-f649-4da0-8317-3e2055a21802 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:49.786290 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 172/349] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:49.787146 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98779da-b85d-4531-8a99-17d4830c93a5 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:49.847320 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:49.919014 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98779da-b85d-4531-8a99-17d4830c93a5 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:49.919365 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661b4c5-f649-4da0-8317-3e2055a21802 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:49.963829 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e0ca4-4dee-46e8-aa85-a1924e62f41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:49.964452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e0ca4-4dee-46e8-aa85-a1924e62f41e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.964728 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e0ca4-4dee-46e8-aa85-a1924e62f41e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.964993 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e0ca4-4dee-46e8-aa85-a1924e62f41e None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.965659 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e0ca4-4dee-46e8-aa85-a1924e62f41e None admin] RBAC: Adding query filter params (name=member) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:49.965958 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e0ca4-4dee-46e8-aa85-a1924e62f41e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:49.966499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2be44-051c-411b-aad3-3396e9c7c57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:49.967139 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2be44-051c-411b-aad3-3396e9c7c57a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.967418 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2be44-051c-411b-aad3-3396e9c7c57a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.967626 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e0ca4-4dee-46e8-aa85-a1924e62f41e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:49.967725 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2be44-051c-411b-aad3-3396e9c7c57a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.968401 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2be44-051c-411b-aad3-3396e9c7c57a None admin] RBAC: Adding query filter params (role.id=eb7fb540254848549730933af8f59dcb, user.id=ea7c898add9844e8bd2e425459d53458, scope.system=all) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:49.968706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2be44-051c-411b-aad3-3396e9c7c57a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:49.971075 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2be44-051c-411b-aad3-3396e9c7c57a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:49.980740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 178/350] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:49.981909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d9674-2410-477a-9649-fd63e9e08425 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.982280 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d9674-2410-477a-9649-fd63e9e08425 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.982552 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d9674-2410-477a-9649-fd63e9e08425 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.983983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 179/351] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:49.984681 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d9674-2410-477a-9649-fd63e9e08425 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:49.989039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 173/352] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Aug 19 19:23:49 2022] GET /identity/v3/role_assignments?user.id=ea7c898add9844e8bd2e425459d53458&scope.system=all&role.id=eb7fb540254848549730933af8f59dcb => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:49.989625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2be44-051c-411b-aad3-3396e9c7c57a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:50.053171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:50.125696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d9674-2410-477a-9649-fd63e9e08425 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:50.145684 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:50.146667 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2be44-051c-411b-aad3-3396e9c7c57a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:50.176326 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7a1da-3aa6-46bc-a946-2c53adfdc342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:50.177119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7a1da-3aa6-46bc-a946-2c53adfdc342 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:50.178033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7a1da-3aa6-46bc-a946-2c53adfdc342 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:50.178033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7a1da-3aa6-46bc-a946-2c53adfdc342 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:50.178712 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7a1da-3aa6-46bc-a946-2c53adfdc342 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:50.179079 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7a1da-3aa6-46bc-a946-2c53adfdc342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:50.181498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7a1da-3aa6-46bc-a946-2c53adfdc342 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:50.194280 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 180/353] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:23:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:50.195640 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7a1da-3aa6-46bc-a946-2c53adfdc342 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:50.201263 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9798c0-2d94-4831-8e41-660637c6d53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:50.204753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9798c0-2d94-4831-8e41-660637c6d53c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:50.205322 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9798c0-2d94-4831-8e41-660637c6d53c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:50.205794 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9798c0-2d94-4831-8e41-660637c6d53c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:50.307633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9798c0-2d94-4831-8e41-660637c6d53c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:50.309126 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9798c0-2d94-4831-8e41-660637c6d53c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:50.351925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7a1da-3aa6-46bc-a946-2c53adfdc342 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:50.369144 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:50.402111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bd70e-b424-4d03-a691-30a55c7ab2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:50.402538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bd70e-b424-4d03-a691-30a55c7ab2cc None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:50.402888 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bd70e-b424-4d03-a691-30a55c7ab2cc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:50.403225 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bd70e-b424-4d03-a691-30a55c7ab2cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:50.450345 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 174/354] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:50.453140 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe6b9e-7dfc-4c68-8d64-5cdf1fcf9103 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:50.453640 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe6b9e-7dfc-4c68-8d64-5cdf1fcf9103 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:50.454202 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe6b9e-7dfc-4c68-8d64-5cdf1fcf9103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:50.471931 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:50.473758 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-76fe6b9e-7dfc-4c68-8d64-5cdf1fcf9103 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:50.475223 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-76fe6b9e-7dfc-4c68-8d64-5cdf1fcf9103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:50.501832 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bd70e-b424-4d03-a691-30a55c7ab2cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:50.503584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bd70e-b424-4d03-a691-30a55c7ab2cc None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:50.567815 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 175/355] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:50.568677 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe6b9e-7dfc-4c68-8d64-5cdf1fcf9103 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:50.640791 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 181/356] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:50.642137 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bd70e-b424-4d03-a691-30a55c7ab2cc None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:50.682451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:50.704205 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe6b9e-7dfc-4c68-8d64-5cdf1fcf9103 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:50.742080 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c4e97-6c48-4dbc-a007-be160fa0ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:50.742549 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:50.742902 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c4e97-6c48-4dbc-a007-be160fa0ac8a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:50.743163 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c4e97-6c48-4dbc-a007-be160fa0ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:50.743431 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c4e97-6c48-4dbc-a007-be160fa0ac8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:50.774852 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bd70e-b424-4d03-a691-30a55c7ab2cc None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:50.816023 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea69406-0075-4213-b1c1-73f7767704a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:50.816664 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69406-0075-4213-b1c1-73f7767704a9 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:50.816944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69406-0075-4213-b1c1-73f7767704a9 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:50.817207 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69406-0075-4213-b1c1-73f7767704a9 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:50.818522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea69406-0075-4213-b1c1-73f7767704a9 None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:50.820119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea69406-0075-4213-b1c1-73f7767704a9 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:50.821774 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 182/357] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:50 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:50.822574 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea69406-0075-4213-b1c1-73f7767704a9 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:50.827998 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c4e97-6c48-4dbc-a007-be160fa0ac8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:50.829760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c4e97-6c48-4dbc-a007-be160fa0ac8a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:50.910334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:50.948110 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea69406-0075-4213-b1c1-73f7767704a9 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:50.951560 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 176/358] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:50.952626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233764-8465-4952-a621-7a18802718e6 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:50.952902 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233764-8465-4952-a621-7a18802718e6 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:50.953164 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233764-8465-4952-a621-7a18802718e6 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:50.958861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 177/359] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:50.960016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35233764-8465-4952-a621-7a18802718e6 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:50.986962 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16933932-d38d-4873-a6c9-adec39f9b8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:50.987602 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16933932-d38d-4873-a6c9-adec39f9b8b1 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:50.987876 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16933932-d38d-4873-a6c9-adec39f9b8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:50.988143 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16933932-d38d-4873-a6c9-adec39f9b8b1 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:50.989652 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16933932-d38d-4873-a6c9-adec39f9b8b1 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:50.991237 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16933932-d38d-4873-a6c9-adec39f9b8b1 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:50.992901 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 183/360] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:50 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:50.993920 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16933932-d38d-4873-a6c9-adec39f9b8b1 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:51.009592 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:51.080622 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35233764-8465-4952-a621-7a18802718e6 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:51.112189 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16933932-d38d-4873-a6c9-adec39f9b8b1 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:51.117623 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dfd77-183c-43fd-baee-6eb0d7aeba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:51.118308 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dfd77-183c-43fd-baee-6eb0d7aeba37 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.118641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dfd77-183c-43fd-baee-6eb0d7aeba37 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.118918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dfd77-183c-43fd-baee-6eb0d7aeba37 None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.125293 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dfd77-183c-43fd-baee-6eb0d7aeba37 None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:51.126791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dfd77-183c-43fd-baee-6eb0d7aeba37 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:51.130102 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 178/361] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:23:50 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:51.130781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dfd77-183c-43fd-baee-6eb0d7aeba37 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:51.154341 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473ab55-8b3b-4355-9c51-e97f58247d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:51.155047 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473ab55-8b3b-4355-9c51-e97f58247d80 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.155319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473ab55-8b3b-4355-9c51-e97f58247d80 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.155582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473ab55-8b3b-4355-9c51-e97f58247d80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.167753 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473ab55-8b3b-4355-9c51-e97f58247d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:51.172772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-a473ab55-8b3b-4355-9c51-e97f58247d80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:51.173144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:51.174070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:51.175847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 184/362] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:23:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:51.176768 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef8898-a126-4296-869d-72e329b4272c None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.176768 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef8898-a126-4296-869d-72e329b4272c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.176906 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef8898-a126-4296-869d-72e329b4272c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.198711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-2bef8898-a126-4296-869d-72e329b4272c None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:51.199253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-2bef8898-a126-4296-869d-72e329b4272c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:51.255988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dfd77-183c-43fd-baee-6eb0d7aeba37 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:51.278955 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:51.286540 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 185/363] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:51.287428 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef8898-a126-4296-869d-72e329b4272c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:51.296404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14919d-cb39-43d8-abf5-32ed3bd7b757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:51.297039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14919d-cb39-43d8-abf5-32ed3bd7b757 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.297316 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14919d-cb39-43d8-abf5-32ed3bd7b757 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.297615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14919d-cb39-43d8-abf5-32ed3bd7b757 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.300634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14919d-cb39-43d8-abf5-32ed3bd7b757 None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:51.301531 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14919d-cb39-43d8-abf5-32ed3bd7b757 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:51.307490 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 179/364] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:51 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:51.307490 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14919d-cb39-43d8-abf5-32ed3bd7b757 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:51.430126 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14919d-cb39-43d8-abf5-32ed3bd7b757 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:51.431737 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:51.439546 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef8898-a126-4296-869d-72e329b4272c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:51.476764 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c0896-6391-4424-b393-584e963fc008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:51.477293 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c0896-6391-4424-b393-584e963fc008 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.477569 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c0896-6391-4424-b393-584e963fc008 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.477858 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c0896-6391-4424-b393-584e963fc008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.478601 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c0896-6391-4424-b393-584e963fc008 None admin] RBAC: Adding query filter params (group.id=b641186838154764a0ffb89e6c12c997, role.id=848a48b503dc483fbbc428affa473937, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:51.478906 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c0896-6391-4424-b393-584e963fc008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:51.480360 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c0896-6391-4424-b393-584e963fc008 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:51.482454 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ecf4a-6b60-42a6-a26b-9061fed80fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:51.483323 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ecf4a-6b60-42a6-a26b-9061fed80fa2 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.483753 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ecf4a-6b60-42a6-a26b-9061fed80fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.484168 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ecf4a-6b60-42a6-a26b-9061fed80fa2 None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.485512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ecf4a-6b60-42a6-a26b-9061fed80fa2 None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:51.487188 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 180/365] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 19:23:51 2022] GET /identity/v3/role_assignments?group.id=b641186838154764a0ffb89e6c12c997&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=848a48b503dc483fbbc428affa473937 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:51.488016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c0896-6391-4424-b393-584e963fc008 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:51.488855 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ecf4a-6b60-42a6-a26b-9061fed80fa2 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:51.491090 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 186/366] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:23:51 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:51.492226 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ecf4a-6b60-42a6-a26b-9061fed80fa2 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:51.589040 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:51.630673 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ecf4a-6b60-42a6-a26b-9061fed80fa2 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:51.644580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c0896-6391-4424-b393-584e963fc008 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:51.672079 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d4f0f-813b-4853-a653-a7c395bf2c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:51.673292 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d4f0f-813b-4853-a653-a7c395bf2c0c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.673292 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d4f0f-813b-4853-a653-a7c395bf2c0c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.673292 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d4f0f-813b-4853-a653-a7c395bf2c0c None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.674554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d4f0f-813b-4853-a653-a7c395bf2c0c None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:51.676052 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d4f0f-813b-4853-a653-a7c395bf2c0c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:51.677860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 187/367] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:23:51 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:51.682915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d4f0f-813b-4853-a653-a7c395bf2c0c None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:51.693866 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e6bba-6195-42b8-a184-8627f6c53d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:51.694612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e6bba-6195-42b8-a184-8627f6c53d86 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.695022 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e6bba-6195-42b8-a184-8627f6c53d86 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.695286 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e6bba-6195-42b8-a184-8627f6c53d86 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.695961 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e6bba-6195-42b8-a184-8627f6c53d86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:51.696250 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e6bba-6195-42b8-a184-8627f6c53d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:51.697870 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e6bba-6195-42b8-a184-8627f6c53d86 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:51.708133 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 181/368] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:23:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:51.709113 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e6bba-6195-42b8-a184-8627f6c53d86 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:51.745228 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:51.807046 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d4f0f-813b-4853-a653-a7c395bf2c0c None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:51.831639 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e6bba-6195-42b8-a184-8627f6c53d86 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:51.847136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeb77d-6ed6-40dd-a153-cd566301df1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:51.850815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeb77d-6ed6-40dd-a153-cd566301df1f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.850815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeb77d-6ed6-40dd-a153-cd566301df1f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.850815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeb77d-6ed6-40dd-a153-cd566301df1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.850815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdeb77d-6ed6-40dd-a153-cd566301df1f None admin] RBAC: Adding query filter params (group.id=b641186838154764a0ffb89e6c12c997, role.id=848a48b503dc483fbbc428affa473937, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:51.850815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdeb77d-6ed6-40dd-a153-cd566301df1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:51.852548 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdeb77d-6ed6-40dd-a153-cd566301df1f None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:51.855405 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:51.866215 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 188/369] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 19:23:51 2022] GET /identity/v3/role_assignments?group.id=b641186838154764a0ffb89e6c12c997&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=848a48b503dc483fbbc428affa473937 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:51.867737 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeb77d-6ed6-40dd-a153-cd566301df1f None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:51.890541 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca43ba4-83c2-4198-a9ed-0116920697c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:51.891327 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca43ba4-83c2-4198-a9ed-0116920697c9 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.891668 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca43ba4-83c2-4198-a9ed-0116920697c9 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.892001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca43ba4-83c2-4198-a9ed-0116920697c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.906462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca43ba4-83c2-4198-a9ed-0116920697c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-1ca43ba4-83c2-4198-a9ed-0116920697c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:51.913753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:51.914959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:51.915746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 182/370] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:23:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:51.919829 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca43ba4-83c2-4198-a9ed-0116920697c9 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:52.007694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeb77d-6ed6-40dd-a153-cd566301df1f None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:52.046527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca43ba4-83c2-4198-a9ed-0116920697c9 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:52.052881 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:52.087581 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e946-d586-4735-b675-af84c5a21e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:52.089227 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e946-d586-4735-b675-af84c5a21e9f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:52.090398 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e946-d586-4735-b675-af84c5a21e9f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:52.090736 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e946-d586-4735-b675-af84c5a21e9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:52.091791 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757e946-d586-4735-b675-af84c5a21e9f None admin] RBAC: Adding query filter params (group.id=b641186838154764a0ffb89e6c12c997, role.id=cee2b2731e93403d9f425e05f6905b53, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:52.092227 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757e946-d586-4735-b675-af84c5a21e9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:52.093712 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757e946-d586-4735-b675-af84c5a21e9f None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:52.099241 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2774a96-3611-40e1-9099-dc2a0749dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:52.100079 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2774a96-3611-40e1-9099-dc2a0749dfe0 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:52.100507 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2774a96-3611-40e1-9099-dc2a0749dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:52.100779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2774a96-3611-40e1-9099-dc2a0749dfe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:52.102152 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 189/371] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 19:23:51 2022] GET /identity/v3/role_assignments?group.id=b641186838154764a0ffb89e6c12c997&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=cee2b2731e93403d9f425e05f6905b53 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:52.103058 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e946-d586-4735-b675-af84c5a21e9f None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:52.191032 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2774a96-3611-40e1-9099-dc2a0749dfe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:52.192632 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2774a96-3611-40e1-9099-dc2a0749dfe0 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:52.225917 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:52.309139 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e946-d586-4735-b675-af84c5a21e9f None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:52.339342 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:52.364774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 183/372] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:23:52.371198 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2774a96-3611-40e1-9099-dc2a0749dfe0 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:52.383101 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da608910-6162-4c34-a755-f150a7dce8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:52.383717 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608910-6162-4c34-a755-f150a7dce8c5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:52.383993 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608910-6162-4c34-a755-f150a7dce8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:52.384258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608910-6162-4c34-a755-f150a7dce8c5 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:52.384912 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da608910-6162-4c34-a755-f150a7dce8c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:52.385207 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da608910-6162-4c34-a755-f150a7dce8c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:52.386648 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da608910-6162-4c34-a755-f150a7dce8c5 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:52.397074 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 190/373] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:52.405602 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da608910-6162-4c34-a755-f150a7dce8c5 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:52.505134 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2774a96-3611-40e1-9099-dc2a0749dfe0 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:52.534358 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da608910-6162-4c34-a755-f150a7dce8c5 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:52.552762 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5153d-b072-4d35-a196-03f248574056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:52.553407 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5153d-b072-4d35-a196-03f248574056 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:52.553680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5153d-b072-4d35-a196-03f248574056 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:52.553949 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5153d-b072-4d35-a196-03f248574056 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:52.558691 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5153d-b072-4d35-a196-03f248574056 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:52.560326 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5153d-b072-4d35-a196-03f248574056 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:52.562456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 184/374] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:52 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:52.565651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:52.571008 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5153d-b072-4d35-a196-03f248574056 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:52.577299 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f559830-255e-4363-8d87-06c38fdb177e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:52.577931 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f559830-255e-4363-8d87-06c38fdb177e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:52.578239 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f559830-255e-4363-8d87-06c38fdb177e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:52.578507 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f559830-255e-4363-8d87-06c38fdb177e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:52.693181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:52.705753 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f559830-255e-4363-8d87-06c38fdb177e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:52.707291 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f559830-255e-4363-8d87-06c38fdb177e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:52.825395 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5153d-b072-4d35-a196-03f248574056 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:52.875034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 191/375] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:23:52.881205 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f559830-255e-4363-8d87-06c38fdb177e None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:52.923478 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7f7ba-a905-45f7-b12f-aeb753779295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:52.924135 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7f7ba-a905-45f7-b12f-aeb753779295 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:52.924413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7f7ba-a905-45f7-b12f-aeb753779295 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:52.924683 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7f7ba-a905-45f7-b12f-aeb753779295 None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:52.930908 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7f7ba-a905-45f7-b12f-aeb753779295 None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:52.931482 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:52.932410 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7f7ba-a905-45f7-b12f-aeb753779295 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:52.934317 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 185/376] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:23:52 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:52.963105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7f7ba-a905-45f7-b12f-aeb753779295 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:53.012994 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f559830-255e-4363-8d87-06c38fdb177e None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:53.049768 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e538-a57d-4ba4-b16e-9eca176bb4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:53.050658 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e538-a57d-4ba4-b16e-9eca176bb4d8 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:53.051147 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e538-a57d-4ba4-b16e-9eca176bb4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:53.051509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e538-a57d-4ba4-b16e-9eca176bb4d8 None admin] PATH_INFO: `/v3/projects/5477f1d1785b40499847c6f71cd220c2` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:53.052727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91e538-a57d-4ba4-b16e-9eca176bb4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=5477f1d1785b40499847c6f71cd220c2)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:53.054350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91e538-a57d-4ba4-b16e-9eca176bb4d8 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:53.056220 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 192/377] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:52 2022] GET /identity/v3/projects/5477f1d1785b40499847c6f71cd220c2 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:53.062931 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e538-a57d-4ba4-b16e-9eca176bb4d8 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:53.189580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7f7ba-a905-45f7-b12f-aeb753779295 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:53.225963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:53.242434 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:53.248841 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858f870-9751-4915-9bd2-045dd0c74e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:53.249456 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e538-a57d-4ba4-b16e-9eca176bb4d8 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:53.249567 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858f870-9751-4915-9bd2-045dd0c74e91 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:53.249798 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858f870-9751-4915-9bd2-045dd0c74e91 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:53.250017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858f870-9751-4915-9bd2-045dd0c74e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:53.250764 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858f870-9751-4915-9bd2-045dd0c74e91 None admin] RBAC: Adding query filter params (group.id=b641186838154764a0ffb89e6c12c997, role.id=cee2b2731e93403d9f425e05f6905b53, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:53.251066 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858f870-9751-4915-9bd2-045dd0c74e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:53.252753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858f870-9751-4915-9bd2-045dd0c74e91 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:53.268865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 186/378] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 19:23:52 2022] GET /identity/v3/role_assignments?group.id=b641186838154764a0ffb89e6c12c997&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=cee2b2731e93403d9f425e05f6905b53 => generated 260 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:53.312866 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca99b-3bee-4098-941c-340a19cc1706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:53.313596 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca99b-3bee-4098-941c-340a19cc1706 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:53.313880 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca99b-3bee-4098-941c-340a19cc1706 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:53.314188 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca99b-3bee-4098-941c-340a19cc1706 None admin] PATH_INFO: `/v3/groups/83e7d9878c204d13b041754eb4b32c7c` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:53.328201 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ca99b-3bee-4098-941c-340a19cc1706 None admin] RBAC: Authorizing `identity:get_group(group_id=83e7d9878c204d13b041754eb4b32c7c)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:53.329693 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ca99b-3bee-4098-941c-340a19cc1706 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:53.331635 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 193/379] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:23:53 2022] GET /identity/v3/groups/83e7d9878c204d13b041754eb4b32c7c => generated 229 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:53.337529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858f870-9751-4915-9bd2-045dd0c74e91 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:53.519496 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858f870-9751-4915-9bd2-045dd0c74e91 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:53.566498 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9878856-8629-4249-b94c-b8bb35f99343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:53.567105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878856-8629-4249-b94c-b8bb35f99343 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:53.567380 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878856-8629-4249-b94c-b8bb35f99343 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:53.567650 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878856-8629-4249-b94c-b8bb35f99343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:53.568372 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9878856-8629-4249-b94c-b8bb35f99343 None admin] RBAC: Adding query filter params (group.id=83e7d9878c204d13b041754eb4b32c7c, role.id=4ef4b944934e44a28a394ebd1a816f64, scope.project.id=5477f1d1785b40499847c6f71cd220c2) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:53.568675 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9878856-8629-4249-b94c-b8bb35f99343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:53.570124 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9878856-8629-4249-b94c-b8bb35f99343 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:53.582661 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 187/380] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 19:23:53 2022] GET /identity/v3/role_assignments?group.id=83e7d9878c204d13b041754eb4b32c7c&scope.project.id=5477f1d1785b40499847c6f71cd220c2&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:54.313033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1ba01-ac35-48f8-a0fc-51f2f18e2439 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:54.313590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1ba01-ac35-48f8-a0fc-51f2f18e2439 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:54.313590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1ba01-ac35-48f8-a0fc-51f2f18e2439 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:54.315169 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 194/381] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:54.321310 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57519d80-0a4a-442b-83c9-6ce9956784c2 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:54.321754 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57519d80-0a4a-442b-83c9-6ce9956784c2 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:54.322273 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57519d80-0a4a-442b-83c9-6ce9956784c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:54.350990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-57519d80-0a4a-442b-83c9-6ce9956784c2 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:54.352194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-57519d80-0a4a-442b-83c9-6ce9956784c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:54.413510 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:54.440632 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 188/382] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:54.731568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612275a3-683a-474c-b715-5d145346d44d None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:54.732047 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612275a3-683a-474c-b715-5d145346d44d None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:54.732229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612275a3-683a-474c-b715-5d145346d44d None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:54.734052 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 195/383] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:54.739540 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb42b8-1ae7-4949-8f93-a6062c80382c None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:54.740032 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb42b8-1ae7-4949-8f93-a6062c80382c None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:54.740203 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb42b8-1ae7-4949-8f93-a6062c80382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:54.767141 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-7dfb42b8-1ae7-4949-8f93-a6062c80382c None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:54.768922 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-7dfb42b8-1ae7-4949-8f93-a6062c80382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:54.828087 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619cf4-2350-4fc7-b5ab-ef9a2e635204 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:54.828702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619cf4-2350-4fc7-b5ab-ef9a2e635204 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:54.829179 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619cf4-2350-4fc7-b5ab-ef9a2e635204 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:54.831002 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 196/384] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:54.838024 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04189bc3-4b29-40df-876c-5dba312ed898 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:54.838024 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04189bc3-4b29-40df-876c-5dba312ed898 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:54.838024 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04189bc3-4b29-40df-876c-5dba312ed898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:54.854214 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 189/385] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:54.864831 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb42b8-1ae7-4949-8f93-a6062c80382c None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:54.877310 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-04189bc3-4b29-40df-876c-5dba312ed898 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:54.878560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-04189bc3-4b29-40df-876c-5dba312ed898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:55.018325 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb42b8-1ae7-4949-8f93-a6062c80382c None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:55.032682 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:55.036269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 197/386] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:55.069472 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690b16-bb75-498f-ac7d-9bafeb0e96ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:55.070370 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690b16-bb75-498f-ac7d-9bafeb0e96ac None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:55.070788 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690b16-bb75-498f-ac7d-9bafeb0e96ac None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:55.071226 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690b16-bb75-498f-ac7d-9bafeb0e96ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:55.087413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d690b16-bb75-498f-ac7d-9bafeb0e96ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-7d690b16-bb75-498f-ac7d-9bafeb0e96ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:55.092470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:55.093535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:55.094588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:55.096590 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 190/387] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:55.102834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04189bc3-4b29-40df-876c-5dba312ed898 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:55.209059 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:55.224090 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04189bc3-4b29-40df-876c-5dba312ed898 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:55.268455 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9f8b4-504d-46dc-bd67-7181410dba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:55.269038 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f8b4-504d-46dc-bd67-7181410dba10 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:55.269327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f8b4-504d-46dc-bd67-7181410dba10 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:55.269589 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f8b4-504d-46dc-bd67-7181410dba10 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:55.271304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690b16-bb75-498f-ac7d-9bafeb0e96ac None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:55.272210 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9f8b4-504d-46dc-bd67-7181410dba10 None admin] RBAC: Adding query filter params (name=member) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:55.272519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9f8b4-504d-46dc-bd67-7181410dba10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:55.273927 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9f8b4-504d-46dc-bd67-7181410dba10 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:55.298019 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 198/388] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:55.298019 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9f8b4-504d-46dc-bd67-7181410dba10 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:55.413792 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9f8b4-504d-46dc-bd67-7181410dba10 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:55.447962 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9cff-7d66-4027-a5ae-006f2c81750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:55.448601 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9cff-7d66-4027-a5ae-006f2c81750b None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:55.448874 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9cff-7d66-4027-a5ae-006f2c81750b None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:55.449141 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9cff-7d66-4027-a5ae-006f2c81750b None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:55.450281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9cff-7d66-4027-a5ae-006f2c81750b None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:55.451869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9cff-7d66-4027-a5ae-006f2c81750b None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:55.453804 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 199/389] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:23:55 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:55.460521 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9cff-7d66-4027-a5ae-006f2c81750b None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:55.470409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690b16-bb75-498f-ac7d-9bafeb0e96ac None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:55.499774 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:55.523080 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaf914-2883-47a3-895e-b932ec835125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:55.523624 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaf914-2883-47a3-895e-b932ec835125 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:55.523896 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaf914-2883-47a3-895e-b932ec835125 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:55.524155 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaf914-2883-47a3-895e-b932ec835125 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:55.537740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daaf914-2883-47a3-895e-b932ec835125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-7daaf914-2883-47a3-895e-b932ec835125 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:55.544232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:55.545918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:55.546781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:55.550066 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 191/390] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:23:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:23:55.551270 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaf914-2883-47a3-895e-b932ec835125 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:55.594400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:55.598629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9cff-7d66-4027-a5ae-006f2c81750b None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:55.634883 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2dd85-7e53-4597-973f-6679f6d3f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:55.635913 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2dd85-7e53-4597-973f-6679f6d3f448 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:55.636385 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2dd85-7e53-4597-973f-6679f6d3f448 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:55.636852 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2dd85-7e53-4597-973f-6679f6d3f448 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:55.638666 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2dd85-7e53-4597-973f-6679f6d3f448 None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:55.640487 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2dd85-7e53-4597-973f-6679f6d3f448 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:55.642787 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 200/391] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:55 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:55.643782 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2dd85-7e53-4597-973f-6679f6d3f448 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:55.677969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaf914-2883-47a3-895e-b932ec835125 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:55.718411 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be2471-6553-4360-9c55-5092831077b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:55.719600 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2471-6553-4360-9c55-5092831077b3 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:55.720130 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2471-6553-4360-9c55-5092831077b3 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:55.720593 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2471-6553-4360-9c55-5092831077b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:55.734528 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be2471-6553-4360-9c55-5092831077b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-68be2471-6553-4360-9c55-5092831077b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:55.740456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:55.741774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:55.742594 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:55.745642 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 192/392] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:55.746633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:55.748827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be2471-6553-4360-9c55-5092831077b3 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:55.769708 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2dd85-7e53-4597-973f-6679f6d3f448 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:55.813837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58ff6c-4ea2-4571-a29e-2e4541cb06a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:55.814439 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ff6c-4ea2-4571-a29e-2e4541cb06a2 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:55.814699 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ff6c-4ea2-4571-a29e-2e4541cb06a2 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:55.814968 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ff6c-4ea2-4571-a29e-2e4541cb06a2 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:55.815891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58ff6c-4ea2-4571-a29e-2e4541cb06a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:55.816195 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58ff6c-4ea2-4571-a29e-2e4541cb06a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:55.817727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58ff6c-4ea2-4571-a29e-2e4541cb06a2 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:55.828383 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 201/393] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:23:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:55.830769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58ff6c-4ea2-4571-a29e-2e4541cb06a2 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:55.859071 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:55.870517 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be2471-6553-4360-9c55-5092831077b3 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:55.911456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e6e69-24bb-45de-9535-6c5fdd0557f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:55.912643 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e6e69-24bb-45de-9535-6c5fdd0557f2 None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:55.913163 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e6e69-24bb-45de-9535-6c5fdd0557f2 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:55.913709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e6e69-24bb-45de-9535-6c5fdd0557f2 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/groups/b641186838154764a0ffb89e6c12c997/roles/848a48b503dc483fbbc428affa473937` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:55.916606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e6e69-24bb-45de-9535-6c5fdd0557f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=84253ede8aa34d9bb8638223c2d7ad79, group_id=b641186838154764a0ffb89e6c12c997, role_id=848a48b503dc483fbbc428affa473937)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:55.918573 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e6e69-24bb-45de-9535-6c5fdd0557f2 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:55.937098 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 193/394] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Aug 19 19:23:55 2022] PUT /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/groups/b641186838154764a0ffb89e6c12c997/roles/848a48b503dc483fbbc428affa473937 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:55.938548 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e6e69-24bb-45de-9535-6c5fdd0557f2 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:55.958998 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58ff6c-4ea2-4571-a29e-2e4541cb06a2 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:55.999601 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a3ae3-3206-4747-9fb7-d80ad7a83594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:56.000527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a3ae3-3206-4747-9fb7-d80ad7a83594 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.000638 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a3ae3-3206-4747-9fb7-d80ad7a83594 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.000980 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a3ae3-3206-4747-9fb7-d80ad7a83594 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.001884 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a3ae3-3206-4747-9fb7-d80ad7a83594 None admin] RBAC: Adding query filter params (name=member) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:56.002695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a3ae3-3206-4747-9fb7-d80ad7a83594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:56.003938 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a3ae3-3206-4747-9fb7-d80ad7a83594 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:56.014498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 202/395] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:56.020305 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a3ae3-3206-4747-9fb7-d80ad7a83594 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:56.033678 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:56.075350 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e6e69-24bb-45de-9535-6c5fdd0557f2 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:56.120536 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2e237-2bf3-43c3-8214-1518a8f6b57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:56.121684 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e237-2bf3-43c3-8214-1518a8f6b57e None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.122181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e237-2bf3-43c3-8214-1518a8f6b57e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.122658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e237-2bf3-43c3-8214-1518a8f6b57e None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.124316 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2e237-2bf3-43c3-8214-1518a8f6b57e None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:56.126124 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2e237-2bf3-43c3-8214-1518a8f6b57e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:56.128000 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a3ae3-3206-4747-9fb7-d80ad7a83594 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:56.128489 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 194/396] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:23:55 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:56.143492 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2e237-2bf3-43c3-8214-1518a8f6b57e None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:56.170980 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c69df-b060-4065-bdb1-9ca57e0bd40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:56.171659 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c69df-b060-4065-bdb1-9ca57e0bd40a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.171932 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c69df-b060-4065-bdb1-9ca57e0bd40a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.172198 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c69df-b060-4065-bdb1-9ca57e0bd40a None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.173401 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c69df-b060-4065-bdb1-9ca57e0bd40a None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:56.174944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c69df-b060-4065-bdb1-9ca57e0bd40a None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:56.179380 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:56.181674 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 203/397] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:23:56 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:56.183231 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c0003-3b7a-41d7-82b9-4863dab3e346 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.183512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c0003-3b7a-41d7-82b9-4863dab3e346 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.183787 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c0003-3b7a-41d7-82b9-4863dab3e346 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.185455 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 204/398] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:56.186741 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c0003-3b7a-41d7-82b9-4863dab3e346 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:56.276874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2e237-2bf3-43c3-8214-1518a8f6b57e None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:56.285357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:56.310723 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c0003-3b7a-41d7-82b9-4863dab3e346 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:56.312895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37937b-5c85-4182-8efd-c2fbfb3bb8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:56.313538 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37937b-5c85-4182-8efd-c2fbfb3bb8f0 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.313811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37937b-5c85-4182-8efd-c2fbfb3bb8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.314172 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37937b-5c85-4182-8efd-c2fbfb3bb8f0 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.315656 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37937b-5c85-4182-8efd-c2fbfb3bb8f0 None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:56.316784 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37937b-5c85-4182-8efd-c2fbfb3bb8f0 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:56.318769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 195/399] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:56 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:56.319916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76219ef5-a9e2-4b78-8a62-a3e2dc771893 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.320194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76219ef5-a9e2-4b78-8a62-a3e2dc771893 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.320465 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76219ef5-a9e2-4b78-8a62-a3e2dc771893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.339379 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-76219ef5-a9e2-4b78-8a62-a3e2dc771893 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:56.340603 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-76219ef5-a9e2-4b78-8a62-a3e2dc771893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:56.347837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e671b-83f0-42fd-b9e5-826c14a68c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:56.348546 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e671b-83f0-42fd-b9e5-826c14a68c04 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.348900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e671b-83f0-42fd-b9e5-826c14a68c04 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.349268 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e671b-83f0-42fd-b9e5-826c14a68c04 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.350512 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e671b-83f0-42fd-b9e5-826c14a68c04 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:56.352054 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e671b-83f0-42fd-b9e5-826c14a68c04 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:56.353925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 205/400] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:56 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:56.359758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13513f-b0c2-4e9e-8837-e570a1c8c087 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.360038 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13513f-b0c2-4e9e-8837-e570a1c8c087 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.360303 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13513f-b0c2-4e9e-8837-e570a1c8c087 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.365645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 206/401] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:56.365645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13513f-b0c2-4e9e-8837-e570a1c8c087 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:56.416990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 196/402] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:56.418089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76219ef5-a9e2-4b78-8a62-a3e2dc771893 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:56.439415 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:56.476432 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13513f-b0c2-4e9e-8837-e570a1c8c087 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:56.514488 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b84dc-42f4-47b5-80e4-d115a82c6c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:56.515320 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b84dc-42f4-47b5-80e4-d115a82c6c15 None admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.515753 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b84dc-42f4-47b5-80e4-d115a82c6c15 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.516119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b84dc-42f4-47b5-80e4-d115a82c6c15 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/groups/b641186838154764a0ffb89e6c12c997/roles/cee2b2731e93403d9f425e05f6905b53` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.518741 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b84dc-42f4-47b5-80e4-d115a82c6c15 None admin] RBAC: Authorizing `identity:create_grant(project_id=84253ede8aa34d9bb8638223c2d7ad79, group_id=b641186838154764a0ffb89e6c12c997, role_id=cee2b2731e93403d9f425e05f6905b53)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:56.520388 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b84dc-42f4-47b5-80e4-d115a82c6c15 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:56.534229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76219ef5-a9e2-4b78-8a62-a3e2dc771893 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:56.539550 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 207/403] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Aug 19 19:23:56 2022] PUT /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79/groups/b641186838154764a0ffb89e6c12c997/roles/cee2b2731e93403d9f425e05f6905b53 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:56.540725 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916724f-b7c0-4216-b356-29dc4a08003f None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.541475 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916724f-b7c0-4216-b356-29dc4a08003f None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.541845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916724f-b7c0-4216-b356-29dc4a08003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.565321 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:56.582878 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-7916724f-b7c0-4216-b356-29dc4a08003f None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:56.586393 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-7916724f-b7c0-4216-b356-29dc4a08003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:56.606571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5459e3b-b309-4aa0-865f-95baa31c24aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:56.607574 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5459e3b-b309-4aa0-865f-95baa31c24aa None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.609663 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5459e3b-b309-4aa0-865f-95baa31c24aa None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.610163 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5459e3b-b309-4aa0-865f-95baa31c24aa None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/groups/b641186838154764a0ffb89e6c12c997/roles/848a48b503dc483fbbc428affa473937` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.615278 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5459e3b-b309-4aa0-865f-95baa31c24aa None admin] RBAC: Authorizing `identity:create_grant(project_id=80ecaf0386c44de0a3d32d38fec6ea60, group_id=b641186838154764a0ffb89e6c12c997, role_id=848a48b503dc483fbbc428affa473937)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:56.617270 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5459e3b-b309-4aa0-865f-95baa31c24aa None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:56.646031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 197/404] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Aug 19 19:23:56 2022] PUT /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/groups/b641186838154764a0ffb89e6c12c997/roles/848a48b503dc483fbbc428affa473937 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:56.701114 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 208/405] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:23:56.809914 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5459e3b-b309-4aa0-865f-95baa31c24aa None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:56.902698 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:56.927586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5459e3b-b309-4aa0-865f-95baa31c24aa None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:56.964142 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a074a8-da68-4897-b9fe-b5c2fb5dcea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:56.965186 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a074a8-da68-4897-b9fe-b5c2fb5dcea2 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.965533 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a074a8-da68-4897-b9fe-b5c2fb5dcea2 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.965839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a074a8-da68-4897-b9fe-b5c2fb5dcea2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.983800 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a074a8-da68-4897-b9fe-b5c2fb5dcea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-88a074a8-da68-4897-b9fe-b5c2fb5dcea2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:56.988674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:56.989568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:56.990413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 198/406] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:23:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:56.995770 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916724f-b7c0-4216-b356-29dc4a08003f None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:57.086099 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a074a8-da68-4897-b9fe-b5c2fb5dcea2 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:57.131836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916724f-b7c0-4216-b356-29dc4a08003f None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:57.175794 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5350f-b162-4e87-8f3c-50693f8f9341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:57.176347 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5350f-b162-4e87-8f3c-50693f8f9341 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:57.176624 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5350f-b162-4e87-8f3c-50693f8f9341 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:57.176902 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5350f-b162-4e87-8f3c-50693f8f9341 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:57.177575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5350f-b162-4e87-8f3c-50693f8f9341 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:57.177880 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5350f-b162-4e87-8f3c-50693f8f9341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:57.179295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5350f-b162-4e87-8f3c-50693f8f9341 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:57.181842 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:57.196821 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 209/407] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:57.202268 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5350f-b162-4e87-8f3c-50693f8f9341 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:57.256866 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a074a8-da68-4897-b9fe-b5c2fb5dcea2 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:57.325009 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5a309-6832-4c70-a245-6d6d167b266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:57.326270 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5a309-6832-4c70-a245-6d6d167b266d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:57.327765 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5a309-6832-4c70-a245-6d6d167b266d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:57.329203 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5a309-6832-4c70-a245-6d6d167b266d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:57.344012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:57.352840 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5a309-6832-4c70-a245-6d6d167b266d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-c3d5a309-6832-4c70-a245-6d6d167b266d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:57.358229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:57.359195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:23:57.359982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:23:57.366682 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 199/408] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:23:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:23:57.368756 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5a309-6832-4c70-a245-6d6d167b266d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:57.403909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5350f-b162-4e87-8f3c-50693f8f9341 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:57.450874 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae06aa-173a-4c7a-833c-ff860737906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:57.451412 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae06aa-173a-4c7a-833c-ff860737906d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:57.451688 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae06aa-173a-4c7a-833c-ff860737906d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:57.451958 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae06aa-173a-4c7a-833c-ff860737906d None admin] PATH_INFO: `/v3/groups/83e7d9878c204d13b041754eb4b32c7c` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:57.453917 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae06aa-173a-4c7a-833c-ff860737906d None admin] RBAC: Authorizing `identity:get_group(group_id=83e7d9878c204d13b041754eb4b32c7c)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:57.455443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae06aa-173a-4c7a-833c-ff860737906d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:57.457283 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 210/409] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:23:57 2022] GET /identity/v3/groups/83e7d9878c204d13b041754eb4b32c7c => generated 229 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:57.463738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae06aa-173a-4c7a-833c-ff860737906d None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:57.549454 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:57.568134 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5a309-6832-4c70-a245-6d6d167b266d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:57.588783 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae06aa-173a-4c7a-833c-ff860737906d None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:57.619337 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3e652-a723-4414-a1c1-41602660f2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:57.620073 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3e652-a723-4414-a1c1-41602660f2ba None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:57.620440 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3e652-a723-4414-a1c1-41602660f2ba None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:57.620711 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3e652-a723-4414-a1c1-41602660f2ba None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:57.621365 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3e652-a723-4414-a1c1-41602660f2ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:57.621667 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3e652-a723-4414-a1c1-41602660f2ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:57.623434 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3e652-a723-4414-a1c1-41602660f2ba None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:57.629055 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1f837-75d7-460e-b77a-67eebc269140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:57.629963 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1f837-75d7-460e-b77a-67eebc269140 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:57.630272 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1f837-75d7-460e-b77a-67eebc269140 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:57.630544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1f837-75d7-460e-b77a-67eebc269140 None admin] PATH_INFO: `/v3/projects/5477f1d1785b40499847c6f71cd220c2` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:57.631689 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1f837-75d7-460e-b77a-67eebc269140 None admin] RBAC: Authorizing `identity:get_project(project_id=5477f1d1785b40499847c6f71cd220c2)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:57.632124 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 200/410] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:23:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:23:57.633176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1f837-75d7-460e-b77a-67eebc269140 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:57.638658 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 211/411] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:57 2022] GET /identity/v3/projects/5477f1d1785b40499847c6f71cd220c2 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:57.639891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3e652-a723-4414-a1c1-41602660f2ba None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:57.643592 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1f837-75d7-460e-b77a-67eebc269140 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:57.762859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1f837-75d7-460e-b77a-67eebc269140 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:57.800677 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:57.812278 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701441ad-7ee1-4f5d-ada2-991ca12351a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:57.812968 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701441ad-7ee1-4f5d-ada2-991ca12351a2 None admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:57.813244 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701441ad-7ee1-4f5d-ada2-991ca12351a2 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:57.813582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701441ad-7ee1-4f5d-ada2-991ca12351a2 None admin] PATH_INFO: `/v3/projects/5477f1d1785b40499847c6f71cd220c2/groups/83e7d9878c204d13b041754eb4b32c7c/roles/4ef4b944934e44a28a394ebd1a816f64` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:57.815590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701441ad-7ee1-4f5d-ada2-991ca12351a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5477f1d1785b40499847c6f71cd220c2, group_id=83e7d9878c204d13b041754eb4b32c7c, role_id=4ef4b944934e44a28a394ebd1a816f64)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:57.817056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701441ad-7ee1-4f5d-ada2-991ca12351a2 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:57.824418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:57.841111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 212/412] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Aug 19 19:23:57 2022] PUT /identity/v3/projects/5477f1d1785b40499847c6f71cd220c2/groups/83e7d9878c204d13b041754eb4b32c7c/roles/4ef4b944934e44a28a394ebd1a816f64 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:23:57.866587 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3e652-a723-4414-a1c1-41602660f2ba None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:57.921497 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc42407-3518-4cd0-bcb8-96f208323f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:57.922165 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc42407-3518-4cd0-bcb8-96f208323f79 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:57.922439 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc42407-3518-4cd0-bcb8-96f208323f79 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:57.922707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc42407-3518-4cd0-bcb8-96f208323f79 None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:57.923830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc42407-3518-4cd0-bcb8-96f208323f79 None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:57.925294 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc42407-3518-4cd0-bcb8-96f208323f79 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:57.927354 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 201/413] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:23:57 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:57.935780 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701441ad-7ee1-4f5d-ada2-991ca12351a2 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:58.079580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701441ad-7ee1-4f5d-ada2-991ca12351a2 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:58.116937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c2b3-83bd-4a5b-a369-850313f74fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:58.117873 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c2b3-83bd-4a5b-a369-850313f74fdb None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:58.118333 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c2b3-83bd-4a5b-a369-850313f74fdb None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:58.118752 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c2b3-83bd-4a5b-a369-850313f74fdb None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:58.120291 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356c2b3-83bd-4a5b-a369-850313f74fdb None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:58.122047 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356c2b3-83bd-4a5b-a369-850313f74fdb None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:58.124742 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 213/414] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:57 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:58.132156 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc42407-3518-4cd0-bcb8-96f208323f79 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:58.264540 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc42407-3518-4cd0-bcb8-96f208323f79 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:58.300369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:58.312120 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087be99-9aad-41fb-8da6-49ef55a25439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:58.312964 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087be99-9aad-41fb-8da6-49ef55a25439 None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:58.313310 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087be99-9aad-41fb-8da6-49ef55a25439 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:58.313747 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087be99-9aad-41fb-8da6-49ef55a25439 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/groups/b641186838154764a0ffb89e6c12c997/roles/cee2b2731e93403d9f425e05f6905b53` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:58.315999 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087be99-9aad-41fb-8da6-49ef55a25439 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ecaf0386c44de0a3d32d38fec6ea60, group_id=b641186838154764a0ffb89e6c12c997, role_id=cee2b2731e93403d9f425e05f6905b53)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:58.317458 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087be99-9aad-41fb-8da6-49ef55a25439 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:58.337531 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 202/415] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Aug 19 19:23:58 2022] PUT /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60/groups/b641186838154764a0ffb89e6c12c997/roles/cee2b2731e93403d9f425e05f6905b53 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:23:58.599470 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4828c1-7e64-48a3-82a8-8e1f6a4593a5 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:58.600482 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4828c1-7e64-48a3-82a8-8e1f6a4593a5 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:58.600965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4828c1-7e64-48a3-82a8-8e1f6a4593a5 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:58.602605 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 214/416] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:58.608825 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5455-8d27-4490-9a06-ade774e1e244 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:58.609367 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5455-8d27-4490-9a06-ade774e1e244 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:58.609849 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5455-8d27-4490-9a06-ade774e1e244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:58.633654 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-4d2c5455-8d27-4490-9a06-ade774e1e244 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:58.635251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-4d2c5455-8d27-4490-9a06-ade774e1e244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:58.721685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 203/417] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:59.057772 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4828c1-7e64-48a3-82a8-8e1f6a4593a5 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:59.126942 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:59.175406 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4828c1-7e64-48a3-82a8-8e1f6a4593a5 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:59.224767 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bfa18-7885-4584-9fd4-f6a4e0248867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:59.225788 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bfa18-7885-4584-9fd4-f6a4e0248867 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:59.226284 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bfa18-7885-4584-9fd4-f6a4e0248867 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:59.226776 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bfa18-7885-4584-9fd4-f6a4e0248867 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:59.238919 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bfa18-7885-4584-9fd4-f6a4e0248867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-bb5bfa18-7885-4584-9fd4-f6a4e0248867 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:23:59.244060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:23:59.244965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:23:59.245766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:23:59.249377 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 215/418] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:23:59.255621 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c5455-8d27-4490-9a06-ade774e1e244 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:59.339655 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae79f4-ab3a-42d3-8adb-5a29dbfe514d None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:59.339958 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae79f4-ab3a-42d3-8adb-5a29dbfe514d None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:59.340608 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae79f4-ab3a-42d3-8adb-5a29dbfe514d None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:59.342037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 216/419] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:59.347459 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbac17-ce8f-4af1-8b47-2d97b7d14f8a None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:59.348008 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbac17-ce8f-4af1-8b47-2d97b7d14f8a None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:59.348476 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbac17-ce8f-4af1-8b47-2d97b7d14f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:59.367529 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-f1fbac17-ce8f-4af1-8b47-2d97b7d14f8a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:59.369128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-f1fbac17-ce8f-4af1-8b47-2d97b7d14f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:59.369266 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c5455-8d27-4490-9a06-ade774e1e244 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:59.395187 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:59.425662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dca2db-5ccd-49ed-9591-58e0188e4524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:59.426312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dca2db-5ccd-49ed-9591-58e0188e4524 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:59.426593 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dca2db-5ccd-49ed-9591-58e0188e4524 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:59.426863 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dca2db-5ccd-49ed-9591-58e0188e4524 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:59.427533 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dca2db-5ccd-49ed-9591-58e0188e4524 None admin] RBAC: Adding query filter params (name=member) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:23:59.427835 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dca2db-5ccd-49ed-9591-58e0188e4524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:59.429226 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dca2db-5ccd-49ed-9591-58e0188e4524 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:59.446527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 204/420] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:23:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:59.448269 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dca2db-5ccd-49ed-9591-58e0188e4524 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:59.489599 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 217/421] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:59.556153 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dca2db-5ccd-49ed-9591-58e0188e4524 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:59.591194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394dc69-29ef-4048-b05a-7b26d617a239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:59.591728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394dc69-29ef-4048-b05a-7b26d617a239 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:59.592000 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394dc69-29ef-4048-b05a-7b26d617a239 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:59.592263 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394dc69-29ef-4048-b05a-7b26d617a239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:59.602564 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4671d8-e9d2-48e2-87bc-ba3e070b0e9c None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:59.603481 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4671d8-e9d2-48e2-87bc-ba3e070b0e9c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:59.603949 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4671d8-e9d2-48e2-87bc-ba3e070b0e9c None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:59.605727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 218/422] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:59.611173 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e1d2-e43e-492d-ad93-92e092dc67bf None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:59.611687 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e1d2-e43e-492d-ad93-92e092dc67bf None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:59.612159 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e1d2-e43e-492d-ad93-92e092dc67bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:59.631045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-1776e1d2-e43e-492d-ad93-92e092dc67bf None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:59.632537 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-1776e1d2-e43e-492d-ad93-92e092dc67bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:59.647572 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:59.677121 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394dc69-29ef-4048-b05a-7b26d617a239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:59.678633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394dc69-29ef-4048-b05a-7b26d617a239 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:59.689214 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:59.746373 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 219/423] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:23:59.789792 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 205/424] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:23:59.796337 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776e1d2-e43e-492d-ad93-92e092dc67bf None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:59.896729 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394dc69-29ef-4048-b05a-7b26d617a239 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:59.899216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776e1d2-e43e-492d-ad93-92e092dc67bf None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:59.973068 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9bcd6-a12f-4479-8ec1-2996e469b748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:59.974108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9bcd6-a12f-4479-8ec1-2996e469b748 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:59.974606 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9bcd6-a12f-4479-8ec1-2996e469b748 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:59.975072 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9bcd6-a12f-4479-8ec1-2996e469b748 None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:59.976405 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9bcd6-a12f-4479-8ec1-2996e469b748 None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:59.978100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9bcd6-a12f-4479-8ec1-2996e469b748 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:59.986463 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 220/425] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:23:59 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:23:59.993682 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9bcd6-a12f-4479-8ec1-2996e469b748 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:59.994478 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:00.063587 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:00.076264 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394dc69-29ef-4048-b05a-7b26d617a239 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:00.109795 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9bcd6-a12f-4479-8ec1-2996e469b748 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:00.142559 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f2a68-ce0e-4a68-a576-f94174419514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:00.143202 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f2a68-ce0e-4a68-a576-f94174419514 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:00.143480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f2a68-ce0e-4a68-a576-f94174419514 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:00.143746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f2a68-ce0e-4a68-a576-f94174419514 None admin] PATH_INFO: `/v3/roles/member` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:00.155651 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f2a68-ce0e-4a68-a576-f94174419514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:00.156853 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8c762-bf8d-4d85-85cd-1d5af72305b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:00.157739 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8c762-bf8d-4d85-85cd-1d5af72305b4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:00.158254 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8c762-bf8d-4d85-85cd-1d5af72305b4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:00.158715 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8c762-bf8d-4d85-85cd-1d5af72305b4 None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:00.160063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8c762-bf8d-4d85-85cd-1d5af72305b4 None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-5e3f2a68-ce0e-4a68-a576-f94174419514 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:00.160846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:00.161718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:00.162586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 206/426] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:23:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:00.163734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f2a68-ce0e-4a68-a576-f94174419514 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:00.164855 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8c762-bf8d-4d85-85cd-1d5af72305b4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:00.167657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 221/427] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:23:59 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:00.174989 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8c762-bf8d-4d85-85cd-1d5af72305b4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:00.280817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f2a68-ce0e-4a68-a576-f94174419514 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:00.314957 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8c762-bf8d-4d85-85cd-1d5af72305b4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:00.326986 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e51bd-073d-4085-b284-3c0bfd260d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:00.327766 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e51bd-073d-4085-b284-3c0bfd260d8b None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:00.328144 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e51bd-073d-4085-b284-3c0bfd260d8b None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:00.328739 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e51bd-073d-4085-b284-3c0bfd260d8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:00.336978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:00.338544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:00.341021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e51bd-073d-4085-b284-3c0bfd260d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-712e51bd-073d-4085-b284-3c0bfd260d8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:00.346883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:00.347955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:24:00.348974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:00.355957 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 207/428] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:24:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:00.356914 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e51bd-073d-4085-b284-3c0bfd260d8b None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:00.364839 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84570d99-edb5-47d3-957a-c4925460f21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:00.365746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84570d99-edb5-47d3-957a-c4925460f21f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:00.366191 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84570d99-edb5-47d3-957a-c4925460f21f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:00.366624 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84570d99-edb5-47d3-957a-c4925460f21f None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:00.368029 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84570d99-edb5-47d3-957a-c4925460f21f None admin] RBAC: Adding query filter params (name=member) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:00.368572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84570d99-edb5-47d3-957a-c4925460f21f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:00.370580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84570d99-edb5-47d3-957a-c4925460f21f None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:00.382282 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 222/429] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:24:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:00.383646 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84570d99-edb5-47d3-957a-c4925460f21f None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:00.488715 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e51bd-073d-4085-b284-3c0bfd260d8b None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:00.524368 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8630c9-2b25-4de0-9ea5-6186f7eeaf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:00.525116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8630c9-2b25-4de0-9ea5-6186f7eeaf11 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:00.525489 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8630c9-2b25-4de0-9ea5-6186f7eeaf11 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:00.525793 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84570d99-edb5-47d3-957a-c4925460f21f None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:00.525918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8630c9-2b25-4de0-9ea5-6186f7eeaf11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:00.526787 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8630c9-2b25-4de0-9ea5-6186f7eeaf11 None admin] RBAC: Adding query filter params (group.id=b641186838154764a0ffb89e6c12c997, role.id=848a48b503dc483fbbc428affa473937, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:00.527203 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8630c9-2b25-4de0-9ea5-6186f7eeaf11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:00.529481 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8630c9-2b25-4de0-9ea5-6186f7eeaf11 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:00.542657 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 208/430] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 19:24:00 2022] GET /identity/v3/role_assignments?group.id=b641186838154764a0ffb89e6c12c997&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=848a48b503dc483fbbc428affa473937 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:00.543789 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8630c9-2b25-4de0-9ea5-6186f7eeaf11 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:00.568814 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801da9e-8f5b-4abc-851e-f6e402015b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:00.569697 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801da9e-8f5b-4abc-851e-f6e402015b8e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:00.570151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801da9e-8f5b-4abc-851e-f6e402015b8e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:00.570562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801da9e-8f5b-4abc-851e-f6e402015b8e None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:00.571654 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801da9e-8f5b-4abc-851e-f6e402015b8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:00.572201 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801da9e-8f5b-4abc-851e-f6e402015b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:00.573837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801da9e-8f5b-4abc-851e-f6e402015b8e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:00.590420 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 223/431] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:00.593060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801da9e-8f5b-4abc-851e-f6e402015b8e None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:00.653180 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:00.660318 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:00.705964 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8630c9-2b25-4de0-9ea5-6186f7eeaf11 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:00.746055 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69141cb-0687-4dc1-9fbf-96103c552f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:00.746440 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69141cb-0687-4dc1-9fbf-96103c552f51 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:00.746719 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69141cb-0687-4dc1-9fbf-96103c552f51 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:00.746993 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69141cb-0687-4dc1-9fbf-96103c552f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:00.750556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801da9e-8f5b-4abc-851e-f6e402015b8e None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:00.801519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59cbeb-880d-430c-b92f-d4a28b46f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:00.802933 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59cbeb-880d-430c-b92f-d4a28b46f8fa None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:00.803692 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59cbeb-880d-430c-b92f-d4a28b46f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:00.804161 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59cbeb-880d-430c-b92f-d4a28b46f8fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:00.835956 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69141cb-0687-4dc1-9fbf-96103c552f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:00.837521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69141cb-0687-4dc1-9fbf-96103c552f51 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:00.909282 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59cbeb-880d-430c-b92f-d4a28b46f8fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:00.912443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59cbeb-880d-430c-b92f-d4a28b46f8fa None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:00.915781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:00.968147 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:00.970695 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 209/432] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:24:00.973282 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad686e-fd25-4064-993d-40c14b82e4fd None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:00.973593 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad686e-fd25-4064-993d-40c14b82e4fd None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:00.973899 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad686e-fd25-4064-993d-40c14b82e4fd None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:00.976821 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 210/433] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:00.980185 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad686e-fd25-4064-993d-40c14b82e4fd None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:01.054357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 224/434] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:24:01.060271 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c6dc7-afb6-4396-bd35-5810d80b8e4f None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:01.061331 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c6dc7-afb6-4396-bd35-5810d80b8e4f None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:01.061438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c6dc7-afb6-4396-bd35-5810d80b8e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:01.081769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-3c9c6dc7-afb6-4396-bd35-5810d80b8e4f None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:01.083004 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-3c9c6dc7-afb6-4396-bd35-5810d80b8e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:01.110191 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad686e-fd25-4064-993d-40c14b82e4fd None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:01.149733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790646d-004c-44ee-a3d7-7bab0b1b0479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:01.150521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790646d-004c-44ee-a3d7-7bab0b1b0479 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:01.150785 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790646d-004c-44ee-a3d7-7bab0b1b0479 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:01.151055 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790646d-004c-44ee-a3d7-7bab0b1b0479 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:01.152172 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790646d-004c-44ee-a3d7-7bab0b1b0479 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:01.153828 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790646d-004c-44ee-a3d7-7bab0b1b0479 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:01.160548 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 211/435] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:24:00 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:01.160548 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790646d-004c-44ee-a3d7-7bab0b1b0479 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:01.167749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 225/436] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:01.174076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c6dc7-afb6-4396-bd35-5810d80b8e4f None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:01.193663 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:01.269118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790646d-004c-44ee-a3d7-7bab0b1b0479 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:01.274732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:01.308011 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746fed9-0467-4732-8cce-3469f2b0a1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:01.308656 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fed9-0467-4732-8cce-3469f2b0a1fd None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:01.308999 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fed9-0467-4732-8cce-3469f2b0a1fd None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:01.309483 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fed9-0467-4732-8cce-3469f2b0a1fd None admin] PATH_INFO: `/v3/projects/84253ede8aa34d9bb8638223c2d7ad79` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:01.311171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746fed9-0467-4732-8cce-3469f2b0a1fd None admin] RBAC: Authorizing `identity:get_project(project_id=84253ede8aa34d9bb8638223c2d7ad79)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:01.312970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746fed9-0467-4732-8cce-3469f2b0a1fd None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:01.314622 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 212/437] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:24:01 2022] GET /identity/v3/projects/84253ede8aa34d9bb8638223c2d7ad79 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:01.315985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c6dc7-afb6-4396-bd35-5810d80b8e4f None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:01.320361 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746fed9-0467-4732-8cce-3469f2b0a1fd None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:01.355922 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4c630-d93a-43f1-9422-003e2823b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:01.356565 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4c630-d93a-43f1-9422-003e2823b987 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:01.357008 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4c630-d93a-43f1-9422-003e2823b987 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:01.357290 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4c630-d93a-43f1-9422-003e2823b987 None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:01.358441 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4c630-d93a-43f1-9422-003e2823b987 None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:01.359885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4c630-d93a-43f1-9422-003e2823b987 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:01.361477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 226/438] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:24:01 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:01.363301 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb28ea-a3d6-4f69-be1b-8a0ff2285558 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:01.364254 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb28ea-a3d6-4f69-be1b-8a0ff2285558 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:01.364743 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb28ea-a3d6-4f69-be1b-8a0ff2285558 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:01.366645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 227/439] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:01.371564 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb28ea-a3d6-4f69-be1b-8a0ff2285558 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:01.438174 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:01.441517 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746fed9-0467-4732-8cce-3469f2b0a1fd None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:01.480166 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d3ba4-7119-45e4-beb4-e6c1b0493409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:01.480796 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3ba4-7119-45e4-beb4-e6c1b0493409 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:01.481082 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3ba4-7119-45e4-beb4-e6c1b0493409 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:01.481333 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3ba4-7119-45e4-beb4-e6c1b0493409 None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:01.482990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d3ba4-7119-45e4-beb4-e6c1b0493409 None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:01.483098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb28ea-a3d6-4f69-be1b-8a0ff2285558 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:01.484417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d3ba4-7119-45e4-beb4-e6c1b0493409 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:01.486014 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 213/440] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:24:01 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:01.487188 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16b60-e1af-41c1-a9b4-ed7ba3fbb279 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:01.487469 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16b60-e1af-41c1-a9b4-ed7ba3fbb279 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:01.487737 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16b60-e1af-41c1-a9b4-ed7ba3fbb279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:01.507551 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-f1e16b60-e1af-41c1-a9b4-ed7ba3fbb279 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:01.508171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-f1e16b60-e1af-41c1-a9b4-ed7ba3fbb279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:01.523455 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddde8b4-e384-4b39-b20f-7e61e170e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:01.524065 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddde8b4-e384-4b39-b20f-7e61e170e2fc None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:01.524345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddde8b4-e384-4b39-b20f-7e61e170e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:01.524622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddde8b4-e384-4b39-b20f-7e61e170e2fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:01.525340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddde8b4-e384-4b39-b20f-7e61e170e2fc None admin] RBAC: Adding query filter params (group.id=b641186838154764a0ffb89e6c12c997, role.id=848a48b503dc483fbbc428affa473937, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:01.525645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddde8b4-e384-4b39-b20f-7e61e170e2fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:01.527130 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddde8b4-e384-4b39-b20f-7e61e170e2fc None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:01.532971 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 228/441] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 19:24:01 2022] GET /identity/v3/role_assignments?group.id=b641186838154764a0ffb89e6c12c997&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=848a48b503dc483fbbc428affa473937 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:01.533752 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddde8b4-e384-4b39-b20f-7e61e170e2fc None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:01.538035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:01.587171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 214/442] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:01.587969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e16b60-e1af-41c1-a9b4-ed7ba3fbb279 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:01.659931 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddde8b4-e384-4b39-b20f-7e61e170e2fc None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:01.699903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44564ef-8e8b-4247-983c-cb932f9b0988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:01.700694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44564ef-8e8b-4247-983c-cb932f9b0988 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:01.701081 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44564ef-8e8b-4247-983c-cb932f9b0988 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:01.701388 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44564ef-8e8b-4247-983c-cb932f9b0988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:01.702340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44564ef-8e8b-4247-983c-cb932f9b0988 None admin] RBAC: Adding query filter params (group.id=b641186838154764a0ffb89e6c12c997, role.id=cee2b2731e93403d9f425e05f6905b53, scope.project.id=84253ede8aa34d9bb8638223c2d7ad79) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:01.702653 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44564ef-8e8b-4247-983c-cb932f9b0988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:01.704226 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44564ef-8e8b-4247-983c-cb932f9b0988 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:01.711475 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 229/443] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 19:24:01 2022] GET /identity/v3/role_assignments?group.id=b641186838154764a0ffb89e6c12c997&scope.project.id=84253ede8aa34d9bb8638223c2d7ad79&role.id=cee2b2731e93403d9f425e05f6905b53 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:01.734608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:01.739404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e16b60-e1af-41c1-a9b4-ed7ba3fbb279 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:01.785911 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf57b-221d-42f0-8ea4-8e90a79c9a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:01.786593 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf57b-221d-42f0-8ea4-8e90a79c9a41 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:01.786865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf57b-221d-42f0-8ea4-8e90a79c9a41 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:01.787134 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf57b-221d-42f0-8ea4-8e90a79c9a41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:01.803658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cf57b-221d-42f0-8ea4-8e90a79c9a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-2d8cf57b-221d-42f0-8ea4-8e90a79c9a41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:01.808685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:01.809607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:01.810612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 215/444] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:24:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:01.816909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44564ef-8e8b-4247-983c-cb932f9b0988 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:01.893271 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:01.923493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf57b-221d-42f0-8ea4-8e90a79c9a41 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:01.930822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44564ef-8e8b-4247-983c-cb932f9b0988 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:01.971209 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49ef04-ec2d-4e85-8049-5b5a5fbc68e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:01.972142 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49ef04-ec2d-4e85-8049-5b5a5fbc68e4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:01.972595 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49ef04-ec2d-4e85-8049-5b5a5fbc68e4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:01.972872 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49ef04-ec2d-4e85-8049-5b5a5fbc68e4 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:01.973542 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49ef04-ec2d-4e85-8049-5b5a5fbc68e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:01.973844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49ef04-ec2d-4e85-8049-5b5a5fbc68e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:01.975760 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49ef04-ec2d-4e85-8049-5b5a5fbc68e4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:01.986587 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 230/445] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:24:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:01.992483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49ef04-ec2d-4e85-8049-5b5a5fbc68e4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:02.052735 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf57b-221d-42f0-8ea4-8e90a79c9a41 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:02.093432 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38ace2-4d3a-4f00-b6c2-f4f3202f90cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:02.094099 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ace2-4d3a-4f00-b6c2-f4f3202f90cd None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:02.094377 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ace2-4d3a-4f00-b6c2-f4f3202f90cd None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:02.095269 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ace2-4d3a-4f00-b6c2-f4f3202f90cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:02.107343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38ace2-4d3a-4f00-b6c2-f4f3202f90cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-4d38ace2-4d3a-4f00-b6c2-f4f3202f90cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:02.112723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:02.113641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:24:02.114493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:02.115125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49ef04-ec2d-4e85-8049-5b5a5fbc68e4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:02.115198 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 216/446] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:24:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:02.121664 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38ace2-4d3a-4f00-b6c2-f4f3202f90cd None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:02.145811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:02.150345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:02.158215 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2296d3a-3cc6-4934-b466-f05e8fcf7ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:02.158876 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2296d3a-3cc6-4934-b466-f05e8fcf7ee9 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:02.159096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2296d3a-3cc6-4934-b466-f05e8fcf7ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:02.159361 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2296d3a-3cc6-4934-b466-f05e8fcf7ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:02.243728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38ace2-4d3a-4f00-b6c2-f4f3202f90cd None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:02.244762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2296d3a-3cc6-4934-b466-f05e8fcf7ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:02.246874 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2296d3a-3cc6-4934-b466-f05e8fcf7ee9 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:02.285695 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6302d-d6ee-4bae-a49b-cea582514bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:02.286385 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6302d-d6ee-4bae-a49b-cea582514bcd None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:02.286665 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6302d-d6ee-4bae-a49b-cea582514bcd None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:02.287817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6302d-d6ee-4bae-a49b-cea582514bcd None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:02.287817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6302d-d6ee-4bae-a49b-cea582514bcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:02.288008 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6302d-d6ee-4bae-a49b-cea582514bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:02.289275 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6302d-d6ee-4bae-a49b-cea582514bcd None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:02.298537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 217/447] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:02.304304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6302d-d6ee-4bae-a49b-cea582514bcd None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:02.360203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 231/448] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:24:02.365936 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2296d3a-3cc6-4934-b466-f05e8fcf7ee9 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:02.385386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:02.394919 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:02.405077 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6302d-d6ee-4bae-a49b-cea582514bcd None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:02.441293 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54e992-efc7-46a7-932b-96d2fa3f63fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:02.442170 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54e992-efc7-46a7-932b-96d2fa3f63fe None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:02.442567 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54e992-efc7-46a7-932b-96d2fa3f63fe None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:02.442925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54e992-efc7-46a7-932b-96d2fa3f63fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:02.479423 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2296d3a-3cc6-4934-b466-f05e8fcf7ee9 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:02.523559 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94128d0-e166-4748-bdf7-3828867b2fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:02.524196 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94128d0-e166-4748-bdf7-3828867b2fe7 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:02.524488 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94128d0-e166-4748-bdf7-3828867b2fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:02.524780 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94128d0-e166-4748-bdf7-3828867b2fe7 None admin] PATH_INFO: `/v3/projects/5477f1d1785b40499847c6f71cd220c2` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:02.526723 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94128d0-e166-4748-bdf7-3828867b2fe7 None admin] RBAC: Authorizing `identity:get_project(project_id=5477f1d1785b40499847c6f71cd220c2)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:02.529587 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94128d0-e166-4748-bdf7-3828867b2fe7 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:02.531439 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 232/449] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:24:02 2022] GET /identity/v3/projects/5477f1d1785b40499847c6f71cd220c2 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:02.536885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94128d0-e166-4748-bdf7-3828867b2fe7 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:02.539114 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54e992-efc7-46a7-932b-96d2fa3f63fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:02.540632 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54e992-efc7-46a7-932b-96d2fa3f63fe None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:02.620507 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:02.635111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:02.639729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94128d0-e166-4748-bdf7-3828867b2fe7 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:02.640846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 218/450] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:24:02.646619 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54e992-efc7-46a7-932b-96d2fa3f63fe None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:02.676824 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9660a-0c5e-4279-bc4e-6e486a4031dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:02.677402 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9660a-0c5e-4279-bc4e-6e486a4031dd None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:02.677681 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9660a-0c5e-4279-bc4e-6e486a4031dd None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:02.677939 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9660a-0c5e-4279-bc4e-6e486a4031dd None admin] PATH_INFO: `/v3/groups/83e7d9878c204d13b041754eb4b32c7c` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:02.679133 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9660a-0c5e-4279-bc4e-6e486a4031dd None admin] RBAC: Authorizing `identity:get_group(group_id=83e7d9878c204d13b041754eb4b32c7c)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:02.680568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9660a-0c5e-4279-bc4e-6e486a4031dd None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:02.682201 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 233/451] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:24:02 2022] GET /identity/v3/groups/83e7d9878c204d13b041754eb4b32c7c => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:02.688274 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9660a-0c5e-4279-bc4e-6e486a4031dd None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:02.754077 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54e992-efc7-46a7-932b-96d2fa3f63fe None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:02.787900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9660a-0c5e-4279-bc4e-6e486a4031dd None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:02.788411 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4740cc-7f7f-4012-ba23-2f280aecd7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:02.788978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4740cc-7f7f-4012-ba23-2f280aecd7f8 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:02.789255 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4740cc-7f7f-4012-ba23-2f280aecd7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:02.789521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4740cc-7f7f-4012-ba23-2f280aecd7f8 None admin] PATH_INFO: `/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:02.791670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4740cc-7f7f-4012-ba23-2f280aecd7f8 None admin] RBAC: Authorizing `identity:get_project(project_id=80ecaf0386c44de0a3d32d38fec6ea60)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:02.794321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4740cc-7f7f-4012-ba23-2f280aecd7f8 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:02.797098 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 219/452] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 19:24:02 2022] GET /identity/v3/projects/80ecaf0386c44de0a3d32d38fec6ea60 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:02.803871 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4740cc-7f7f-4012-ba23-2f280aecd7f8 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:02.839923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa40a7c-6afa-4bf7-8a7c-d7326b158776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:02.840553 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40a7c-6afa-4bf7-8a7c-d7326b158776 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:02.840835 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40a7c-6afa-4bf7-8a7c-d7326b158776 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:02.841314 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40a7c-6afa-4bf7-8a7c-d7326b158776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:02.842071 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa40a7c-6afa-4bf7-8a7c-d7326b158776 None admin] RBAC: Adding query filter params (group.id=83e7d9878c204d13b041754eb4b32c7c, role.id=4ef4b944934e44a28a394ebd1a816f64, scope.project.id=5477f1d1785b40499847c6f71cd220c2) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:02.842380 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa40a7c-6afa-4bf7-8a7c-d7326b158776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:02.843832 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa40a7c-6afa-4bf7-8a7c-d7326b158776 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:02.849923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 234/453] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 19:24:02 2022] GET /identity/v3/role_assignments?group.id=83e7d9878c204d13b041754eb4b32c7c&scope.project.id=5477f1d1785b40499847c6f71cd220c2&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:02.859771 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:02.921264 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4740cc-7f7f-4012-ba23-2f280aecd7f8 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:02.960602 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e784d-4447-47b6-ab5c-f973028a27d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:02.961144 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e784d-4447-47b6-ab5c-f973028a27d6 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:02.961419 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e784d-4447-47b6-ab5c-f973028a27d6 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:02.961687 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e784d-4447-47b6-ab5c-f973028a27d6 None admin] PATH_INFO: `/v3/groups/b641186838154764a0ffb89e6c12c997` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:02.962916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e784d-4447-47b6-ab5c-f973028a27d6 None admin] RBAC: Authorizing `identity:get_group(group_id=b641186838154764a0ffb89e6c12c997)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:02.964450 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e784d-4447-47b6-ab5c-f973028a27d6 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:02.966025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 220/454] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 19:24:02 2022] GET /identity/v3/groups/b641186838154764a0ffb89e6c12c997 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:02.972242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa40a7c-6afa-4bf7-8a7c-d7326b158776 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:03.009275 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:03.085716 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa40a7c-6afa-4bf7-8a7c-d7326b158776 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:03.135708 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28822757-89d7-4883-9ee0-13a001d05ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:03.136308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28822757-89d7-4883-9ee0-13a001d05ea8 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:03.136576 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28822757-89d7-4883-9ee0-13a001d05ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:03.136858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28822757-89d7-4883-9ee0-13a001d05ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:03.137544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28822757-89d7-4883-9ee0-13a001d05ea8 None admin] RBAC: Adding query filter params (group.id=b641186838154764a0ffb89e6c12c997, role.id=cee2b2731e93403d9f425e05f6905b53, scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:03.137847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28822757-89d7-4883-9ee0-13a001d05ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:03.139386 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28822757-89d7-4883-9ee0-13a001d05ea8 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:03.145203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 235/455] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 19:24:02 2022] GET /identity/v3/role_assignments?group.id=b641186838154764a0ffb89e6c12c997&scope.project.id=80ecaf0386c44de0a3d32d38fec6ea60&role.id=cee2b2731e93403d9f425e05f6905b53 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:05.758958 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7a74-dff6-4c11-a798-fbd913ad7c9d None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:05.759493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7a74-dff6-4c11-a798-fbd913ad7c9d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:05.759493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7a74-dff6-4c11-a798-fbd913ad7c9d None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:05.761077 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 221/456] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:05.767341 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea1c79-86ca-43c3-b897-74eb1c406afe None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:05.768161 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea1c79-86ca-43c3-b897-74eb1c406afe None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:05.768572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea1c79-86ca-43c3-b897-74eb1c406afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:05.790304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-85ea1c79-86ca-43c3-b897-74eb1c406afe None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:05.792236 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-85ea1c79-86ca-43c3-b897-74eb1c406afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:05.870763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 236/457] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:24:05.943264 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93ad8e-0746-4f81-9b60-3f294b0bd750 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:05.943903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93ad8e-0746-4f81-9b60-3f294b0bd750 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:05.944376 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93ad8e-0746-4f81-9b60-3f294b0bd750 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:05.946350 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 222/458] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:05.952691 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd6e7-9094-4eaa-86a6-2024a671004f None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:05.953349 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd6e7-9094-4eaa-86a6-2024a671004f None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:05.953819 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd6e7-9094-4eaa-86a6-2024a671004f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:05.973909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-994fd6e7-9094-4eaa-86a6-2024a671004f None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:05.975381 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-994fd6e7-9094-4eaa-86a6-2024a671004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:05.994386 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:06.046345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 237/459] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:06.111288 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7077e9-3aa1-4976-9b59-bdb4f2db737f None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:06.111570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7077e9-3aa1-4976-9b59-bdb4f2db737f None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:06.112032 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7077e9-3aa1-4976-9b59-bdb4f2db737f None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:06.113530 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 223/460] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:06.118991 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0933e-305c-4549-b9d4-bfadfa072fa2 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:06.119473 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0933e-305c-4549-b9d4-bfadfa072fa2 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:06.119891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0933e-305c-4549-b9d4-bfadfa072fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:06.139432 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-41a0933e-305c-4549-b9d4-bfadfa072fa2 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:06.140921 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-41a0933e-305c-4549-b9d4-bfadfa072fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:06.216312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7077e9-3aa1-4976-9b59-bdb4f2db737f None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:06.222745 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 238/461] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:06.359528 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7077e9-3aa1-4976-9b59-bdb4f2db737f None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:06.380254 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:06.399142 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0933e-305c-4549-b9d4-bfadfa072fa2 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:06.402157 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013def43-e6a9-40c9-85ed-e7b9866d519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:06.402938 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013def43-e6a9-40c9-85ed-e7b9866d519d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:06.403208 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013def43-e6a9-40c9-85ed-e7b9866d519d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:06.403541 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013def43-e6a9-40c9-85ed-e7b9866d519d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:06.418897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013def43-e6a9-40c9-85ed-e7b9866d519d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:06.421407 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013def43-e6a9-40c9-85ed-e7b9866d519d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-013def43-e6a9-40c9-85ed-e7b9866d519d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:06.446042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:06.447025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:06.447874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:06.447874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:06.447874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:06.447874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 224/462] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:06.451768 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013def43-e6a9-40c9-85ed-e7b9866d519d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:06.521343 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:06.539842 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0933e-305c-4549-b9d4-bfadfa072fa2 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:06.580666 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28d50b-de79-4923-b3cb-fe221f98beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:06.581196 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28d50b-de79-4923-b3cb-fe221f98beee None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:06.581473 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28d50b-de79-4923-b3cb-fe221f98beee None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:06.581748 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28d50b-de79-4923-b3cb-fe221f98beee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:06.589037 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013def43-e6a9-40c9-85ed-e7b9866d519d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:06.592843 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28d50b-de79-4923-b3cb-fe221f98beee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:06.594351 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28d50b-de79-4923-b3cb-fe221f98beee None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-2e28d50b-de79-4923-b3cb-fe221f98beee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:06.611877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:06.612859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:06.613732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:06.613732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:06.613732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:06.613732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 239/463] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:06.614442 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f4cf-117f-4d27-8638-13c0367d5e55 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:06.614831 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f4cf-117f-4d27-8638-13c0367d5e55 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:06.615303 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f4cf-117f-4d27-8638-13c0367d5e55 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:06.616952 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 240/464] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:06.617510 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3f4cf-117f-4d27-8638-13c0367d5e55 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:06.626451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4c31-c614-471c-8186-c38d61c9278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:06.627058 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4c31-c614-471c-8186-c38d61c9278c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:06.627331 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4c31-c614-471c-8186-c38d61c9278c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:06.627600 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4c31-c614-471c-8186-c38d61c9278c None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:06.628241 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4c31-c614-471c-8186-c38d61c9278c None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:06.628545 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4c31-c614-471c-8186-c38d61c9278c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:06.629909 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4c31-c614-471c-8186-c38d61c9278c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:06.643746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 225/465] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:06.644497 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4c31-c614-471c-8186-c38d61c9278c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:06.675621 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:06.752348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3f4cf-117f-4d27-8638-13c0367d5e55 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:06.759907 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4c31-c614-471c-8186-c38d61c9278c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:06.791282 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0f59f-fb1f-449a-b9b5-7c3ef9e902a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:06.792132 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0f59f-fb1f-449a-b9b5-7c3ef9e902a8 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:06.792245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0f59f-fb1f-449a-b9b5-7c3ef9e902a8 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:06.792462 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0f59f-fb1f-449a-b9b5-7c3ef9e902a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:06.795486 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:06.797241 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9299046-5254-406c-a362-4be4aafb2d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:06.797896 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9299046-5254-406c-a362-4be4aafb2d5c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:06.798198 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9299046-5254-406c-a362-4be4aafb2d5c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:06.798538 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9299046-5254-406c-a362-4be4aafb2d5c None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:06.799193 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9299046-5254-406c-a362-4be4aafb2d5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:06.799492 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9299046-5254-406c-a362-4be4aafb2d5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:06.800899 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9299046-5254-406c-a362-4be4aafb2d5c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:06.804375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0f59f-fb1f-449a-b9b5-7c3ef9e902a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:06.805852 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0f59f-fb1f-449a-b9b5-7c3ef9e902a8 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:06.815158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 226/466] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:06.816540 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d147d43-5140-41f1-bced-0149a1e15670 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:06.816833 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d147d43-5140-41f1-bced-0149a1e15670 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:06.817110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d147d43-5140-41f1-bced-0149a1e15670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-c6b0f59f-fb1f-449a-b9b5-7c3ef9e902a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:06.822452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:06.823532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:06.824588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:06.824588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:06.824588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:06.826198 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 241/467] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:06.832888 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0f59f-fb1f-449a-b9b5-7c3ef9e902a8 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:06.837444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-9d147d43-5140-41f1-bced-0149a1e15670 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:06.839083 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-9d147d43-5140-41f1-bced-0149a1e15670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:06.911464 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 227/468] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:06.912223 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d147d43-5140-41f1-bced-0149a1e15670 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:06.936744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:06.937131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0f59f-fb1f-449a-b9b5-7c3ef9e902a8 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:06.974574 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e6a5b-2ec8-41a2-8c6b-1d1c2daa0f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:06.975183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6a5b-2ec8-41a2-8c6b-1d1c2daa0f15 None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:06.975459 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6a5b-2ec8-41a2-8c6b-1d1c2daa0f15 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:06.975725 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6a5b-2ec8-41a2-8c6b-1d1c2daa0f15 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:06.976370 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e6a5b-2ec8-41a2-8c6b-1d1c2daa0f15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:06.977829 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e6a5b-2ec8-41a2-8c6b-1d1c2daa0f15 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:07.010168 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 242/469] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:24:06 2022] POST /identity/v3/users => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:07.011190 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e6a5b-2ec8-41a2-8c6b-1d1c2daa0f15 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:07.059053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d147d43-5140-41f1-bced-0149a1e15670 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:07.069347 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:07.105026 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1d65c-177f-4959-af8f-07718814c4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:07.106185 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1d65c-177f-4959-af8f-07718814c4dd None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:07.106665 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1d65c-177f-4959-af8f-07718814c4dd None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:07.107385 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1d65c-177f-4959-af8f-07718814c4dd None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:07.108389 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1d65c-177f-4959-af8f-07718814c4dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:07.110634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1d65c-177f-4959-af8f-07718814c4dd None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:07.138312 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e6a5b-2ec8-41a2-8c6b-1d1c2daa0f15 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:07.150188 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 228/470] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:24:06 2022] POST /identity/v3/users => generated 248 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:07.198529 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba830983-40aa-4f86-bd23-1caad45cc3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:07.198529 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba830983-40aa-4f86-bd23-1caad45cc3d7 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:07.198529 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba830983-40aa-4f86-bd23-1caad45cc3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:07.202045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba830983-40aa-4f86-bd23-1caad45cc3d7 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:07.202045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba830983-40aa-4f86-bd23-1caad45cc3d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:07.202045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba830983-40aa-4f86-bd23-1caad45cc3d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:07.202045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba830983-40aa-4f86-bd23-1caad45cc3d7 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:07.218305 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 243/471] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:07.224536 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1d65c-177f-4959-af8f-07718814c4dd None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:07.253271 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba830983-40aa-4f86-bd23-1caad45cc3d7 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:07.326464 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:07.362398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1d65c-177f-4959-af8f-07718814c4dd None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:07.377982 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba830983-40aa-4f86-bd23-1caad45cc3d7 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:07.381477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:07.414756 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf543f-1a3a-4db0-8bb6-6c4f63143339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:07.415341 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf543f-1a3a-4db0-8bb6-6c4f63143339 None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:07.416299 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf543f-1a3a-4db0-8bb6-6c4f63143339 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:07.416715 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf543f-1a3a-4db0-8bb6-6c4f63143339 None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:07.417490 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf543f-1a3a-4db0-8bb6-6c4f63143339 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:07.418994 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf543f-1a3a-4db0-8bb6-6c4f63143339 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:07.421503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcc92d-25db-407a-bf0f-d8ea976c9194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:07.422151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcc92d-25db-407a-bf0f-d8ea976c9194 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:07.422437 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcc92d-25db-407a-bf0f-d8ea976c9194 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:07.422695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcc92d-25db-407a-bf0f-d8ea976c9194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:07.435175 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddcc92d-25db-407a-bf0f-d8ea976c9194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:07.437781 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddcc92d-25db-407a-bf0f-d8ea976c9194 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:07.448416 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 229/472] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:24:07 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-1ddcc92d-25db-407a-bf0f-d8ea976c9194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:07.455534 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:07.456594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:07.457903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:07.457903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:07.457903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:07.457903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 244/473] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:07.464356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf543f-1a3a-4db0-8bb6-6c4f63143339 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:07.587760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf543f-1a3a-4db0-8bb6-6c4f63143339 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:07.621826 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:07.630755 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695ab7b-1b49-4c25-a355-4dccd112a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:07.631723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695ab7b-1b49-4c25-a355-4dccd112a67b None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:07.632140 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695ab7b-1b49-4c25-a355-4dccd112a67b None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:07.632566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695ab7b-1b49-4c25-a355-4dccd112a67b None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:07.633359 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695ab7b-1b49-4c25-a355-4dccd112a67b None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:07.633799 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695ab7b-1b49-4c25-a355-4dccd112a67b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:07.635355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695ab7b-1b49-4c25-a355-4dccd112a67b None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:07.650523 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 230/474] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:07.655996 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcc92d-25db-407a-bf0f-d8ea976c9194 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:07.762505 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcc92d-25db-407a-bf0f-d8ea976c9194 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:07.798959 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa2d8e-e619-473f-b1a6-972d7152aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:07.800287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa2d8e-e619-473f-b1a6-972d7152aca4 None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:07.800706 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa2d8e-e619-473f-b1a6-972d7152aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:07.801113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa2d8e-e619-473f-b1a6-972d7152aca4 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:07.801891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa2d8e-e619-473f-b1a6-972d7152aca4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:07.803479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa2d8e-e619-473f-b1a6-972d7152aca4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:07.828764 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 245/475] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:24:07 2022] POST /identity/v3/users => generated 249 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:09.374266 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ebdec-20eb-4cd7-bd8c-fad5a06cdd60 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:09.374796 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ebdec-20eb-4cd7-bd8c-fad5a06cdd60 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:09.374796 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ebdec-20eb-4cd7-bd8c-fad5a06cdd60 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:09.376393 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 231/476] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:09.381952 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9aa378-050f-49e7-9a6a-da68f8a5b876 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:09.382476 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9aa378-050f-49e7-9a6a-da68f8a5b876 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:09.382551 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9aa378-050f-49e7-9a6a-da68f8a5b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:09.402214 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-7f9aa378-050f-49e7-9a6a-da68f8a5b876 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:09.403420 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-7f9aa378-050f-49e7-9a6a-da68f8a5b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:09.412970 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:09.482466 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 246/477] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:09.580057 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20832e-4e94-468f-bd60-0fe5e9346848 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:09.580057 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20832e-4e94-468f-bd60-0fe5e9346848 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:09.580057 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20832e-4e94-468f-bd60-0fe5e9346848 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:09.580738 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 232/478] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:09.586239 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34711476-7eda-4a33-a4db-d02dbe752c1c None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:09.586705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34711476-7eda-4a33-a4db-d02dbe752c1c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:09.587144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34711476-7eda-4a33-a4db-d02dbe752c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:09.607170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-34711476-7eda-4a33-a4db-d02dbe752c1c None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:09.608969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-34711476-7eda-4a33-a4db-d02dbe752c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:09.694099 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 247/479] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:09.800402 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7672-600e-456a-b5bd-3a4893683d8e None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:09.800677 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7672-600e-456a-b5bd-3a4893683d8e None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:09.800953 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7672-600e-456a-b5bd-3a4893683d8e None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:09.802658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 233/480] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:09.807933 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0c715-25ee-481b-9b8a-778b681b0617 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:09.808069 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e7672-600e-456a-b5bd-3a4893683d8e None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:09.808237 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0c715-25ee-481b-9b8a-778b681b0617 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:09.808622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0c715-25ee-481b-9b8a-778b681b0617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:09.832594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-3aa0c715-25ee-481b-9b8a-778b681b0617 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:09.833923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-3aa0c715-25ee-481b-9b8a-778b681b0617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:09.915659 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e7672-600e-456a-b5bd-3a4893683d8e None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:09.921762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 248/481] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:09.954589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354db755-7a46-46b2-a10c-58dc7eb3094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:09.955500 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354db755-7a46-46b2-a10c-58dc7eb3094d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:09.955909 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354db755-7a46-46b2-a10c-58dc7eb3094d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:09.956308 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354db755-7a46-46b2-a10c-58dc7eb3094d None admin] PATH_INFO: `/v3/roles/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:09.968366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354db755-7a46-46b2-a10c-58dc7eb3094d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-354db755-7a46-46b2-a10c-58dc7eb3094d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:09.973744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:09.974903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:09.975882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:09.978509 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 234/482] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:09.984853 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0c715-25ee-481b-9b8a-778b681b0617 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:09.987897 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:10.035199 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354db755-7a46-46b2-a10c-58dc7eb3094d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:10.091439 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:10.107132 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0c715-25ee-481b-9b8a-778b681b0617 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:10.149775 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9113e2b-cc32-4003-bbbd-0b296d08ec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:10.150425 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9113e2b-cc32-4003-bbbd-0b296d08ec67 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.150698 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9113e2b-cc32-4003-bbbd-0b296d08ec67 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.150986 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9113e2b-cc32-4003-bbbd-0b296d08ec67 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.151620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9113e2b-cc32-4003-bbbd-0b296d08ec67 None admin] RBAC: Adding query filter params (name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:10.151915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9113e2b-cc32-4003-bbbd-0b296d08ec67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:10.153280 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9113e2b-cc32-4003-bbbd-0b296d08ec67 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:10.160341 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354db755-7a46-46b2-a10c-58dc7eb3094d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:10.162433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 249/483] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:10.168715 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248afd0c-1987-4c99-8968-2aa232e86616 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.168999 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248afd0c-1987-4c99-8968-2aa232e86616 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.169272 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248afd0c-1987-4c99-8968-2aa232e86616 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.171031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 250/484] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:10.171599 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248afd0c-1987-4c99-8968-2aa232e86616 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:10.211501 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3580a6c-5812-41c6-abf5-d519a1b55fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:10.212129 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3580a6c-5812-41c6-abf5-d519a1b55fe2 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.212399 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3580a6c-5812-41c6-abf5-d519a1b55fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.212659 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3580a6c-5812-41c6-abf5-d519a1b55fe2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.223386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3580a6c-5812-41c6-abf5-d519a1b55fe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-c3580a6c-5812-41c6-abf5-d519a1b55fe2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:10.228002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:10.228876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:10.229692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:10.234066 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 235/485] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:10.235398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862021bb-890c-4622-96a6-86827a8b40b2 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.235750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862021bb-890c-4622-96a6-86827a8b40b2 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.235872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862021bb-890c-4622-96a6-86827a8b40b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.241317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:10.256035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-862021bb-890c-4622-96a6-86827a8b40b2 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:10.257578 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-862021bb-890c-4622-96a6-86827a8b40b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:10.281324 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248afd0c-1987-4c99-8968-2aa232e86616 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:10.315330 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83b432-99c2-4924-a5be-0e115230ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:10.316113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b432-99c2-4924-a5be-0e115230ea4d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.316390 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b432-99c2-4924-a5be-0e115230ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.316653 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b432-99c2-4924-a5be-0e115230ea4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.323456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 236/486] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:10.324280 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862021bb-890c-4622-96a6-86827a8b40b2 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:10.326779 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83b432-99c2-4924-a5be-0e115230ea4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:10.328223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83b432-99c2-4924-a5be-0e115230ea4d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-4e83b432-99c2-4924-a5be-0e115230ea4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:10.342665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:10.343746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:10.344822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:10.344822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:10.344822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:10.344822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 251/487] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:10.344822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83b432-99c2-4924-a5be-0e115230ea4d None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:10.374581 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:10.438204 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862021bb-890c-4622-96a6-86827a8b40b2 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:10.452114 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83b432-99c2-4924-a5be-0e115230ea4d None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:10.468727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:10.474654 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e1099-f194-441f-8856-da5dda49aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:10.475261 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e1099-f194-441f-8856-da5dda49aa59 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.475524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e1099-f194-441f-8856-da5dda49aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.475789 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e1099-f194-441f-8856-da5dda49aa59 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.476441 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e1099-f194-441f-8856-da5dda49aa59 None admin] RBAC: Adding query filter params (name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:10.476736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e1099-f194-441f-8856-da5dda49aa59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:10.478141 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e1099-f194-441f-8856-da5dda49aa59 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:10.486712 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 237/488] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:10.488494 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b513493-f7cf-4280-aec9-cb0bd7debfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:10.489131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b513493-f7cf-4280-aec9-cb0bd7debfb4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.489406 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b513493-f7cf-4280-aec9-cb0bd7debfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.489679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b513493-f7cf-4280-aec9-cb0bd7debfb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.491312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e1099-f194-441f-8856-da5dda49aa59 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:10.500652 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b513493-f7cf-4280-aec9-cb0bd7debfb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-1b513493-f7cf-4280-aec9-cb0bd7debfb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:10.505389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:10.506544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 252/489] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:10.507329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b513493-f7cf-4280-aec9-cb0bd7debfb4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:10.604324 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e1099-f194-441f-8856-da5dda49aa59 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:10.606261 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:10.611539 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b513493-f7cf-4280-aec9-cb0bd7debfb4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:10.647204 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417aca2-c4b1-4ed1-9613-fd76630c7bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:10.648118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417aca2-c4b1-4ed1-9613-fd76630c7bbf None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.648536 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417aca2-c4b1-4ed1-9613-fd76630c7bbf None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.648945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417aca2-c4b1-4ed1-9613-fd76630c7bbf None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.649720 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417aca2-c4b1-4ed1-9613-fd76630c7bbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:10.650188 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417aca2-c4b1-4ed1-9613-fd76630c7bbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:10.651490 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc150ad9-95c4-4880-b1c3-bc58341741ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:10.651888 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417aca2-c4b1-4ed1-9613-fd76630c7bbf None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:10.652111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc150ad9-95c4-4880-b1c3-bc58341741ba None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.652383 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc150ad9-95c4-4880-b1c3-bc58341741ba None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.652645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc150ad9-95c4-4880-b1c3-bc58341741ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.663810 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc150ad9-95c4-4880-b1c3-bc58341741ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:10.664511 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 238/490] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:10.665339 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417aca2-c4b1-4ed1-9613-fd76630c7bbf None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:10.665443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc150ad9-95c4-4880-b1c3-bc58341741ba None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-dc150ad9-95c4-4880-b1c3-bc58341741ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:10.681245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:10.682418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:10.683460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:10.683460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:10.683460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:10.683460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 253/491] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:10.683460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc150ad9-95c4-4880-b1c3-bc58341741ba None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:10.712998 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:10.769016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417aca2-c4b1-4ed1-9613-fd76630c7bbf None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:10.784337 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc150ad9-95c4-4880-b1c3-bc58341741ba None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:10.803156 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026931ed-79c1-45ec-8c5a-f8daf46b458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:10.803756 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026931ed-79c1-45ec-8c5a-f8daf46b458d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.804031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026931ed-79c1-45ec-8c5a-f8daf46b458d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.804300 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026931ed-79c1-45ec-8c5a-f8daf46b458d None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.804959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026931ed-79c1-45ec-8c5a-f8daf46b458d None admin] RBAC: Adding query filter params (name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:10.805255 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026931ed-79c1-45ec-8c5a-f8daf46b458d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:10.806657 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026931ed-79c1-45ec-8c5a-f8daf46b458d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:10.815156 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 239/492] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:10.815789 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026931ed-79c1-45ec-8c5a-f8daf46b458d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:10.824345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286fc3b-0147-47d9-ab49-9868565c13f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:10.824982 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286fc3b-0147-47d9-ab49-9868565c13f2 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.825256 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286fc3b-0147-47d9-ab49-9868565c13f2 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.825525 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286fc3b-0147-47d9-ab49-9868565c13f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.836582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286fc3b-0147-47d9-ab49-9868565c13f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:10.841019 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-c286fc3b-0147-47d9-ab49-9868565c13f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:10.842213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:10.843183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 254/493] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:10.844062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286fc3b-0147-47d9-ab49-9868565c13f2 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:10.923314 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026931ed-79c1-45ec-8c5a-f8daf46b458d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:10.939122 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:10.952642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286fc3b-0147-47d9-ab49-9868565c13f2 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:10.960717 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2981f15-706d-42e1-8939-24a9f511e1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:10.961336 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2981f15-706d-42e1-8939-24a9f511e1af None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.961602 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2981f15-706d-42e1-8939-24a9f511e1af None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.961938 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2981f15-706d-42e1-8939-24a9f511e1af None admin] PATH_INFO: `/v3/users/nova` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.970200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2981f15-706d-42e1-8939-24a9f511e1af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:10.971637 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2981f15-706d-42e1-8939-24a9f511e1af None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-b2981f15-706d-42e1-8939-24a9f511e1af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:10.984703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:10.985679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 240/494] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 19:24:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:10.986645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2981f15-706d-42e1-8939-24a9f511e1af None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:10.992007 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dcd71-02c6-4393-94e7-bae1e40dd6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:10.992648 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dcd71-02c6-4393-94e7-bae1e40dd6d8 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:10.992927 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dcd71-02c6-4393-94e7-bae1e40dd6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:10.993195 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dcd71-02c6-4393-94e7-bae1e40dd6d8 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:10.993842 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dcd71-02c6-4393-94e7-bae1e40dd6d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:10.994186 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dcd71-02c6-4393-94e7-bae1e40dd6d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:10.995586 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dcd71-02c6-4393-94e7-bae1e40dd6d8 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.008039 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 255/495] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:11.008821 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dcd71-02c6-4393-94e7-bae1e40dd6d8 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.071949 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:11.088556 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2981f15-706d-42e1-8939-24a9f511e1af None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.110287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dcd71-02c6-4393-94e7-bae1e40dd6d8 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.121621 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c6a90-f48f-4984-9675-6d39271810f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.122266 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6a90-f48f-4984-9675-6d39271810f8 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.122539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6a90-f48f-4984-9675-6d39271810f8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.122868 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6a90-f48f-4984-9675-6d39271810f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.133515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c6a90-f48f-4984-9675-6d39271810f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:11.135006 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c6a90-f48f-4984-9675-6d39271810f8 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.145753 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536516eb-5705-425c-b082-bb91157dc2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.146378 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536516eb-5705-425c-b082-bb91157dc2e1 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.146647 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536516eb-5705-425c-b082-bb91157dc2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.146908 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536516eb-5705-425c-b082-bb91157dc2e1 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.147554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536516eb-5705-425c-b082-bb91157dc2e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:11.147820 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536516eb-5705-425c-b082-bb91157dc2e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:11.149196 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536516eb-5705-425c-b082-bb91157dc2e1 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-b52c6a90-f48f-4984-9675-6d39271810f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:11.149329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:11.150216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:11.151076 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:11.151076 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:11.151076 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:11.151076 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 241/496] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:11.151510 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c6a90-f48f-4984-9675-6d39271810f8 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.161906 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 256/497] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:11.162769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536516eb-5705-425c-b082-bb91157dc2e1 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.176318 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:11.259116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c6a90-f48f-4984-9675-6d39271810f8 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.268543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536516eb-5705-425c-b082-bb91157dc2e1 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.292650 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885e7c9-4817-40bc-babe-f49413c76cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.293229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e7c9-4817-40bc-babe-f49413c76cd4 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.293502 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e7c9-4817-40bc-babe-f49413c76cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.293770 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e7c9-4817-40bc-babe-f49413c76cd4 None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.294558 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885e7c9-4817-40bc-babe-f49413c76cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:11.294865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885e7c9-4817-40bc-babe-f49413c76cd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:11.296487 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885e7c9-4817-40bc-babe-f49413c76cd4 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.303639 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478a75a-e632-400b-ab61-daf50cb9e5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.304261 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478a75a-e632-400b-ab61-daf50cb9e5d3 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.304537 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478a75a-e632-400b-ab61-daf50cb9e5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.304805 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478a75a-e632-400b-ab61-daf50cb9e5d3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.308018 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:11.312754 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478a75a-e632-400b-ab61-daf50cb9e5d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:11.314251 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478a75a-e632-400b-ab61-daf50cb9e5d3 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-1478a75a-e632-400b-ab61-daf50cb9e5d3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:11.326815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:11.327721 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:11.328629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:11.328629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:11.328629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:11.328629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:11.328629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:11.328629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:11.328629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:11.328629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:11.328629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:24:11.328629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:11.328629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 257/498] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:11.329187 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478a75a-e632-400b-ab61-daf50cb9e5d3 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.335358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 242/499] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:11.336255 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885e7c9-4817-40bc-babe-f49413c76cd4 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.403516 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:11.445809 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478a75a-e632-400b-ab61-daf50cb9e5d3 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.448621 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885e7c9-4817-40bc-babe-f49413c76cd4 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.479915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe7cf6-3e95-4c66-a62b-d0679e638433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.480532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe7cf6-3e95-4c66-a62b-d0679e638433 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.480799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe7cf6-3e95-4c66-a62b-d0679e638433 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.481065 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe7cf6-3e95-4c66-a62b-d0679e638433 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.481726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe7cf6-3e95-4c66-a62b-d0679e638433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:11.482098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe7cf6-3e95-4c66-a62b-d0679e638433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:11.482855 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb872a45-0076-4743-9dfb-8023d68d1529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.483479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe7cf6-3e95-4c66-a62b-d0679e638433 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.483565 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb872a45-0076-4743-9dfb-8023d68d1529 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.483752 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb872a45-0076-4743-9dfb-8023d68d1529 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.484022 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb872a45-0076-4743-9dfb-8023d68d1529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.494031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb872a45-0076-4743-9dfb-8023d68d1529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:11.495107 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 258/500] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:11.495493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb872a45-0076-4743-9dfb-8023d68d1529 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.496479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe7cf6-3e95-4c66-a62b-d0679e638433 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-eb872a45-0076-4743-9dfb-8023d68d1529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:11.510400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:11.511358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:11.512802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:11.512802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:11.512802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:11.512802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 243/501] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:11.512802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb872a45-0076-4743-9dfb-8023d68d1529 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.558875 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:11.606415 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe7cf6-3e95-4c66-a62b-d0679e638433 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.612646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb872a45-0076-4743-9dfb-8023d68d1529 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.639128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:11.645884 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff279f5c-16e7-490f-8949-991dcf3d3a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.646522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff279f5c-16e7-490f-8949-991dcf3d3a1b None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.646798 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff279f5c-16e7-490f-8949-991dcf3d3a1b None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.647048 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff279f5c-16e7-490f-8949-991dcf3d3a1b None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.647777 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff279f5c-16e7-490f-8949-991dcf3d3a1b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:11.648081 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff279f5c-16e7-490f-8949-991dcf3d3a1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:11.649544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff279f5c-16e7-490f-8949-991dcf3d3a1b None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.651265 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edeece9-456f-4278-822c-c5706a42fc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.651876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeece9-456f-4278-822c-c5706a42fc6a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.652151 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeece9-456f-4278-822c-c5706a42fc6a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.652414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeece9-456f-4278-822c-c5706a42fc6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.685917 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 259/502] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:11.686787 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff279f5c-16e7-490f-8949-991dcf3d3a1b None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.724517 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edeece9-456f-4278-822c-c5706a42fc6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:11.725913 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edeece9-456f-4278-822c-c5706a42fc6a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.772212 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:11.790683 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff279f5c-16e7-490f-8949-991dcf3d3a1b None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.825524 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be036b86-feed-4034-ab18-04946fd2dc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.826307 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be036b86-feed-4034-ab18-04946fd2dc4c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.826552 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be036b86-feed-4034-ab18-04946fd2dc4c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.826818 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be036b86-feed-4034-ab18-04946fd2dc4c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.827081 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 244/503] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:24:11.827924 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edeece9-456f-4278-822c-c5706a42fc6a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.835060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be036b86-feed-4034-ab18-04946fd2dc4c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:11.836527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be036b86-feed-4034-ab18-04946fd2dc4c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-be036b86-feed-4034-ab18-04946fd2dc4c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:11.848714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:11.849651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 260/504] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:11.850584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be036b86-feed-4034-ab18-04946fd2dc4c None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.904879 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:11.934452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edeece9-456f-4278-822c-c5706a42fc6a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.956332 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be036b86-feed-4034-ab18-04946fd2dc4c None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.969234 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f623219-e741-408b-a442-affa1a228e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.969833 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f623219-e741-408b-a442-affa1a228e5e None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.970144 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f623219-e741-408b-a442-affa1a228e5e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.970419 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f623219-e741-408b-a442-affa1a228e5e None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.971052 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f623219-e741-408b-a442-affa1a228e5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:11.971351 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f623219-e741-408b-a442-affa1a228e5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:11.972737 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f623219-e741-408b-a442-affa1a228e5e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.984196 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 245/505] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:11.985088 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f623219-e741-408b-a442-affa1a228e5e None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.994189 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:11.995591 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fea67f-d716-488f-9f60-573fdacbce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.996214 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea67f-d716-488f-9f60-573fdacbce57 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.996493 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea67f-d716-488f-9f60-573fdacbce57 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.996827 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea67f-d716-488f-9f60-573fdacbce57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:12.075827 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fea67f-d716-488f-9f60-573fdacbce57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:12.077363 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fea67f-d716-488f-9f60-573fdacbce57 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:12.085504 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f623219-e741-408b-a442-affa1a228e5e None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:12.120413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c220571-629b-4f2b-a243-d56a67e7ce6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:12.121027 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c220571-629b-4f2b-a243-d56a67e7ce6d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:12.121297 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c220571-629b-4f2b-a243-d56a67e7ce6d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:12.121559 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c220571-629b-4f2b-a243-d56a67e7ce6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:12.125371 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:12.132662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c220571-629b-4f2b-a243-d56a67e7ce6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:12.134157 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c220571-629b-4f2b-a243-d56a67e7ce6d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-8c220571-629b-4f2b-a243-d56a67e7ce6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:12.148521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:12.149452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:12.150343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:12.150343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:12.150343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:12.150343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 246/506] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:12.150573 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c220571-629b-4f2b-a243-d56a67e7ce6d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:12.178457 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 261/507] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:24:12.179293 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fea67f-d716-488f-9f60-573fdacbce57 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:12.218399 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:12.261343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c220571-629b-4f2b-a243-d56a67e7ce6d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:12.279716 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fea67f-d716-488f-9f60-573fdacbce57 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:12.299790 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47d365-e559-48b9-b25c-5195bcaadf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:12.300409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47d365-e559-48b9-b25c-5195bcaadf6a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:12.300682 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47d365-e559-48b9-b25c-5195bcaadf6a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:12.300957 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47d365-e559-48b9-b25c-5195bcaadf6a None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:12.301688 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47d365-e559-48b9-b25c-5195bcaadf6a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:12.302010 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47d365-e559-48b9-b25c-5195bcaadf6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:12.303499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47d365-e559-48b9-b25c-5195bcaadf6a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:12.314087 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b415d9-4cea-4399-8615-7df82fbaf638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:12.314710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b415d9-4cea-4399-8615-7df82fbaf638 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:12.314985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b415d9-4cea-4399-8615-7df82fbaf638 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:12.315252 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b415d9-4cea-4399-8615-7df82fbaf638 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:12.321568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 247/508] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 19:24:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:12.322387 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47d365-e559-48b9-b25c-5195bcaadf6a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:12.322496 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b415d9-4cea-4399-8615-7df82fbaf638 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:12.323974 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b415d9-4cea-4399-8615-7df82fbaf638 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-52b415d9-4cea-4399-8615-7df82fbaf638 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:12.337500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:12.338500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 262/509] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:12.339418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b415d9-4cea-4399-8615-7df82fbaf638 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:12.351641 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:12.425592 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47d365-e559-48b9-b25c-5195bcaadf6a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:12.443648 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:12.448838 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b415d9-4cea-4399-8615-7df82fbaf638 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:12.462336 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e6f2-3cb9-4520-9661-1e5e52ace9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:12.462931 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e6f2-3cb9-4520-9661-1e5e52ace9e7 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:12.463201 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e6f2-3cb9-4520-9661-1e5e52ace9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:12.463462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e6f2-3cb9-4520-9661-1e5e52ace9e7 None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:12.464092 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4e6f2-3cb9-4520-9661-1e5e52ace9e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:12.464381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4e6f2-3cb9-4520-9661-1e5e52ace9e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:12.465756 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4e6f2-3cb9-4520-9661-1e5e52ace9e7 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:12.481148 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 248/510] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:12.481148 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e6f2-3cb9-4520-9661-1e5e52ace9e7 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:12.490317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee68bc-a5c6-4a5b-91b1-0715a789926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:12.490961 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee68bc-a5c6-4a5b-91b1-0715a789926d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:12.491232 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee68bc-a5c6-4a5b-91b1-0715a789926d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:12.491494 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee68bc-a5c6-4a5b-91b1-0715a789926d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:12.504550 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee68bc-a5c6-4a5b-91b1-0715a789926d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:12.506065 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee68bc-a5c6-4a5b-91b1-0715a789926d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-1cee68bc-a5c6-4a5b-91b1-0715a789926d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:12.521035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:12.522267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:12.523149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:12.523149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:12.523149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:12.523149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 263/511] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:12.523149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee68bc-a5c6-4a5b-91b1-0715a789926d None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:12.579281 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e6f2-3cb9-4520-9661-1e5e52ace9e7 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:12.580478 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:12.612084 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee75f3b-afd4-4528-9148-5baed5280810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:12.612679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee75f3b-afd4-4528-9148-5baed5280810 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:12.612953 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee75f3b-afd4-4528-9148-5baed5280810 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:12.613224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee75f3b-afd4-4528-9148-5baed5280810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:12.622491 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee68bc-a5c6-4a5b-91b1-0715a789926d None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:12.657539 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381a7a7-2a7b-462b-8556-73b059e11478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:12.658192 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381a7a7-2a7b-462b-8556-73b059e11478 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:12.658467 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381a7a7-2a7b-462b-8556-73b059e11478 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:12.658740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381a7a7-2a7b-462b-8556-73b059e11478 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:12.659272 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:12.659464 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381a7a7-2a7b-462b-8556-73b059e11478 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:12.659779 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381a7a7-2a7b-462b-8556-73b059e11478 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:12.661431 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381a7a7-2a7b-462b-8556-73b059e11478 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:12.679197 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 264/512] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Aug 19 19:24:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:12.680009 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381a7a7-2a7b-462b-8556-73b059e11478 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:12.683814 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee75f3b-afd4-4528-9148-5baed5280810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:12.685705 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee75f3b-afd4-4528-9148-5baed5280810 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:12.780365 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381a7a7-2a7b-462b-8556-73b059e11478 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:12.785000 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 249/513] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:24:12.785832 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee75f3b-afd4-4528-9148-5baed5280810 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:12.801089 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:12.819250 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d297fe-3731-40cd-b742-b489bdece696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:12.819883 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d297fe-3731-40cd-b742-b489bdece696 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:12.820159 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d297fe-3731-40cd-b742-b489bdece696 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:12.820429 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d297fe-3731-40cd-b742-b489bdece696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:12.828036 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d297fe-3731-40cd-b742-b489bdece696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:12.829491 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d297fe-3731-40cd-b742-b489bdece696 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-e0d297fe-3731-40cd-b742-b489bdece696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:12.840893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:12.842092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:12.843422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:12.843422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:12.843422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:12.843422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:12.843422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:12.843422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:12.843422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:12.843422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:12.843422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 265/514] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:12.843422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d297fe-3731-40cd-b742-b489bdece696 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:12.867077 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:12.889792 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee75f3b-afd4-4528-9148-5baed5280810 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:12.925239 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260321cc-db1f-40bf-8abc-29ebefb7e8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:12.925860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260321cc-db1f-40bf-8abc-29ebefb7e8d9 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:12.926164 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260321cc-db1f-40bf-8abc-29ebefb7e8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:12.926424 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260321cc-db1f-40bf-8abc-29ebefb7e8d9 None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:12.927059 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260321cc-db1f-40bf-8abc-29ebefb7e8d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:12.927357 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260321cc-db1f-40bf-8abc-29ebefb7e8d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:12.928728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260321cc-db1f-40bf-8abc-29ebefb7e8d9 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:12.940729 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 250/515] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:12.941317 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260321cc-db1f-40bf-8abc-29ebefb7e8d9 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:12.950677 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d297fe-3731-40cd-b742-b489bdece696 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:12.985285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead2b5e-7cff-4531-ae66-3bd00af25ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:12.985947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead2b5e-7cff-4531-ae66-3bd00af25ebb None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:12.986247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead2b5e-7cff-4531-ae66-3bd00af25ebb None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:12.986508 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead2b5e-7cff-4531-ae66-3bd00af25ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.033304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:13.044723 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260321cc-db1f-40bf-8abc-29ebefb7e8d9 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:13.056323 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead2b5e-7cff-4531-ae66-3bd00af25ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:13.057809 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead2b5e-7cff-4531-ae66-3bd00af25ebb None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:13.079132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fca431-382f-479e-b06e-998ecb174e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:13.079747 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fca431-382f-479e-b06e-998ecb174e1f None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.080016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fca431-382f-479e-b06e-998ecb174e1f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.080279 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fca431-382f-479e-b06e-998ecb174e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.082934 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:13.091218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fca431-382f-479e-b06e-998ecb174e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:13.092687 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fca431-382f-479e-b06e-998ecb174e1f None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-20fca431-382f-479e-b06e-998ecb174e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:13.106394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:13.107443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:13.108302 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:13.108302 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:13.108302 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:13.108302 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 251/516] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:13.108586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fca431-382f-479e-b06e-998ecb174e1f None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:13.160138 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 266/517] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:24:13.160984 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead2b5e-7cff-4531-ae66-3bd00af25ebb None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:13.212165 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fca431-382f-479e-b06e-998ecb174e1f None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:13.240657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:13.246990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d61be-da40-4e7d-a01c-395a1f6771aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:13.247632 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d61be-da40-4e7d-a01c-395a1f6771aa None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.247916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d61be-da40-4e7d-a01c-395a1f6771aa None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.248207 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d61be-da40-4e7d-a01c-395a1f6771aa None admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.248894 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d61be-da40-4e7d-a01c-395a1f6771aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:13.249192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d61be-da40-4e7d-a01c-395a1f6771aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:13.250680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d61be-da40-4e7d-a01c-395a1f6771aa None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:13.263480 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead2b5e-7cff-4531-ae66-3bd00af25ebb None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:13.268412 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 252/518] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:13.269217 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d61be-da40-4e7d-a01c-395a1f6771aa None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:13.298632 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9381b2-b192-4033-9a88-6f96166c3ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:13.299180 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9381b2-b192-4033-9a88-6f96166c3ba7 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.299456 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9381b2-b192-4033-9a88-6f96166c3ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.299726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9381b2-b192-4033-9a88-6f96166c3ba7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.306626 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9381b2-b192-4033-9a88-6f96166c3ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:13.308104 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9381b2-b192-4033-9a88-6f96166c3ba7 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-0d9381b2-b192-4033-9a88-6f96166c3ba7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:13.319983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:13.320903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:13.321749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:13.321749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:13.321749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:13.321749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:13.321749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:13.321749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:13.321749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:13.321749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:13.321749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 267/519] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:13.322240 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9381b2-b192-4033-9a88-6f96166c3ba7 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:13.326726 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:13.381413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d61be-da40-4e7d-a01c-395a1f6771aa None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:13.414722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78549d-77a9-4907-84c5-55c95ef571fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:13.415335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78549d-77a9-4907-84c5-55c95ef571fc None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.415603 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78549d-77a9-4907-84c5-55c95ef571fc None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.416218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78549d-77a9-4907-84c5-55c95ef571fc None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.416842 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78549d-77a9-4907-84c5-55c95ef571fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:13.417131 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78549d-77a9-4907-84c5-55c95ef571fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:13.418537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78549d-77a9-4907-84c5-55c95ef571fc None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:13.430818 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 253/520] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:13.431617 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78549d-77a9-4907-84c5-55c95ef571fc None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:13.433259 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9381b2-b192-4033-9a88-6f96166c3ba7 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:13.468742 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2f38c-ba69-49d5-b68b-12793169509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:13.469375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2f38c-ba69-49d5-b68b-12793169509d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.469651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2f38c-ba69-49d5-b68b-12793169509d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.469921 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2f38c-ba69-49d5-b68b-12793169509d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.477268 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:13.482407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2f38c-ba69-49d5-b68b-12793169509d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:13.485720 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2f38c-ba69-49d5-b68b-12793169509d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-d1f2f38c-ba69-49d5-b68b-12793169509d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:13.500645 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:13.502092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:13.503370 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:13.503370 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:13.503370 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:13.506381 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 268/521] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:13.507122 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2f38c-ba69-49d5-b68b-12793169509d None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:13.536175 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78549d-77a9-4907-84c5-55c95ef571fc None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:13.546534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:13.574223 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d2f1a-bdf8-48b5-bb70-606538b44b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:13.574741 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d2f1a-bdf8-48b5-bb70-606538b44b1c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.575007 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d2f1a-bdf8-48b5-bb70-606538b44b1c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.575265 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d2f1a-bdf8-48b5-bb70-606538b44b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.576156 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d2f1a-bdf8-48b5-bb70-606538b44b1c None admin] RBAC: Adding query filter params (role.id=db8abf37adff4704889523e773b95924, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=ff0c7740e6814c6c9515d0aed78bba68) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:13.576504 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d2f1a-bdf8-48b5-bb70-606538b44b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:13.577925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d2f1a-bdf8-48b5-bb70-606538b44b1c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:13.583556 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 254/522] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:24:13 2022] GET /identity/v3/role_assignments?user.id=ff0c7740e6814c6c9515d0aed78bba68&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=db8abf37adff4704889523e773b95924 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:13.584328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d2f1a-bdf8-48b5-bb70-606538b44b1c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:13.615029 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2f38c-ba69-49d5-b68b-12793169509d None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:13.661315 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fdd03-b968-4736-8892-73ee444dcd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:13.662383 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fdd03-b968-4736-8892-73ee444dcd26 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.662657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fdd03-b968-4736-8892-73ee444dcd26 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.663110 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fdd03-b968-4736-8892-73ee444dcd26 None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.663840 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fdd03-b968-4736-8892-73ee444dcd26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:13.664137 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fdd03-b968-4736-8892-73ee444dcd26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:13.665688 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fdd03-b968-4736-8892-73ee444dcd26 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:13.686036 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 269/523] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:13.686947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fdd03-b968-4736-8892-73ee444dcd26 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:13.719683 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d2f1a-bdf8-48b5-bb70-606538b44b1c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:13.743909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:13.761433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f106bf-ad74-43cb-b39b-9f7358d337ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:13.762841 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f106bf-ad74-43cb-b39b-9f7358d337ce None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.763119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f106bf-ad74-43cb-b39b-9f7358d337ce None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.763515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f106bf-ad74-43cb-b39b-9f7358d337ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.772586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f106bf-ad74-43cb-b39b-9f7358d337ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:13.774101 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f106bf-ad74-43cb-b39b-9f7358d337ce None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-16f106bf-ad74-43cb-b39b-9f7358d337ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:13.788671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:13.789707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:13.790716 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:13.790716 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:13.790716 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:13.790716 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:13.790716 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:13.790716 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:13.790716 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:13.790716 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:13.790716 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 255/524] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:13.791611 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f106bf-ad74-43cb-b39b-9f7358d337ce None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:13.806048 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fdd03-b968-4736-8892-73ee444dcd26 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:13.825961 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:13.842900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d97e53-8e82-44b1-bf26-d7abca29361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:13.843511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d97e53-8e82-44b1-bf26-d7abca29361f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.843782 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d97e53-8e82-44b1-bf26-d7abca29361f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.844049 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d97e53-8e82-44b1-bf26-d7abca29361f None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.844666 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d97e53-8e82-44b1-bf26-d7abca29361f None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:13.844960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d97e53-8e82-44b1-bf26-d7abca29361f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:13.846366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d97e53-8e82-44b1-bf26-d7abca29361f None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:13.857691 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 270/525] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:13.858554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d97e53-8e82-44b1-bf26-d7abca29361f None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:13.905099 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f106bf-ad74-43cb-b39b-9f7358d337ce None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:13.940616 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0aedb-b51a-4ad7-ae82-9a55919dcc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:13.941484 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0aedb-b51a-4ad7-ae82-9a55919dcc0e None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.941894 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0aedb-b51a-4ad7-ae82-9a55919dcc0e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.942332 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0aedb-b51a-4ad7-ae82-9a55919dcc0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.943338 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0aedb-b51a-4ad7-ae82-9a55919dcc0e None admin] RBAC: Adding query filter params (role.id=db8abf37adff4704889523e773b95924, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=5f36f349d532411ba09da3231aef3f1b) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:13.943865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0aedb-b51a-4ad7-ae82-9a55919dcc0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:13.945627 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0aedb-b51a-4ad7-ae82-9a55919dcc0e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:13.952750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 256/526] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:24:13 2022] GET /identity/v3/role_assignments?user.id=5f36f349d532411ba09da3231aef3f1b&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=db8abf37adff4704889523e773b95924 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:13.953898 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0aedb-b51a-4ad7-ae82-9a55919dcc0e None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:13.973074 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d97e53-8e82-44b1-bf26-d7abca29361f None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:13.986039 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:14.012009 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03ea94-0949-4784-8d77-aad3fb167749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:14.012726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03ea94-0949-4784-8d77-aad3fb167749 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:14.013066 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03ea94-0949-4784-8d77-aad3fb167749 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:14.013509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03ea94-0949-4784-8d77-aad3fb167749 None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:14.014636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03ea94-0949-4784-8d77-aad3fb167749 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:14.015013 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03ea94-0949-4784-8d77-aad3fb167749 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:14.016591 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03ea94-0949-4784-8d77-aad3fb167749 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:14.030036 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 271/527] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:14.035514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03ea94-0949-4784-8d77-aad3fb167749 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:14.082319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:14.090641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0aedb-b51a-4ad7-ae82-9a55919dcc0e None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:14.132706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be424adf-fe7f-4ff9-8a1b-3916c659258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:14.133359 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be424adf-fe7f-4ff9-8a1b-3916c659258a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:14.133818 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be424adf-fe7f-4ff9-8a1b-3916c659258a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:14.134143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be424adf-fe7f-4ff9-8a1b-3916c659258a None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:14.142707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be424adf-fe7f-4ff9-8a1b-3916c659258a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:14.144324 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be424adf-fe7f-4ff9-8a1b-3916c659258a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:14.151026 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03ea94-0949-4784-8d77-aad3fb167749 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-be424adf-fe7f-4ff9-8a1b-3916c659258a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:14.159053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:14.159967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:14.160830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:14.160830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:14.160830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:14.160830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:14.160830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:14.160830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:14.160830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:14.160830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:14.165430 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 257/528] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:14.166776 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be424adf-fe7f-4ff9-8a1b-3916c659258a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:14.190810 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b2132-f3df-458a-8e9b-74168b7ed02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:14.191419 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2132-f3df-458a-8e9b-74168b7ed02d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:14.191692 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2132-f3df-458a-8e9b-74168b7ed02d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:14.191956 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2132-f3df-458a-8e9b-74168b7ed02d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:14.192677 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b2132-f3df-458a-8e9b-74168b7ed02d None admin] RBAC: Adding query filter params (role.id=db8abf37adff4704889523e773b95924, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=d19d16bc47614980b4f6d57e39a0f4b3) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:14.192976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b2132-f3df-458a-8e9b-74168b7ed02d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:14.194451 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b2132-f3df-458a-8e9b-74168b7ed02d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:14.202021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 272/529] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:24:14 2022] GET /identity/v3/role_assignments?user.id=d19d16bc47614980b4f6d57e39a0f4b3&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=db8abf37adff4704889523e773b95924 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:14.289805 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be424adf-fe7f-4ff9-8a1b-3916c659258a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:14.328841 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a56c97-9762-473a-a1c5-4e3b864c41aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:14.329846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a56c97-9762-473a-a1c5-4e3b864c41aa None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:14.330334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a56c97-9762-473a-a1c5-4e3b864c41aa None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:14.330791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a56c97-9762-473a-a1c5-4e3b864c41aa None admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:14.331691 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a56c97-9762-473a-a1c5-4e3b864c41aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:14.332181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a56c97-9762-473a-a1c5-4e3b864c41aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:14.333929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a56c97-9762-473a-a1c5-4e3b864c41aa None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:14.350700 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 258/530] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:14.358098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b2132-f3df-458a-8e9b-74168b7ed02d None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:14.398304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:14.469527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b2132-f3df-458a-8e9b-74168b7ed02d None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:14.505345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aea313-ba16-4db7-8fa8-0b34096401dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:14.506809 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aea313-ba16-4db7-8fa8-0b34096401dc None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:14.507308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aea313-ba16-4db7-8fa8-0b34096401dc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:14.507775 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aea313-ba16-4db7-8fa8-0b34096401dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:14.508701 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aea313-ba16-4db7-8fa8-0b34096401dc None admin] RBAC: Adding query filter params (role.id=db8abf37adff4704889523e773b95924, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=3ba4a0ad60a549bd8255124ffcd83f30) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:14.509225 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aea313-ba16-4db7-8fa8-0b34096401dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:14.510972 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aea313-ba16-4db7-8fa8-0b34096401dc None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:14.517448 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 273/531] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:24:14 2022] GET /identity/v3/role_assignments?user.id=3ba4a0ad60a549bd8255124ffcd83f30&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=db8abf37adff4704889523e773b95924 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:15.814221 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cd279-221c-482b-94cf-b6d81161ad56 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:15.814791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cd279-221c-482b-94cf-b6d81161ad56 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:15.814791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cd279-221c-482b-94cf-b6d81161ad56 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:15.816345 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 259/532] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:15.821936 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac490be-30a3-41ad-b53c-70a459ffc935 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:15.822412 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac490be-30a3-41ad-b53c-70a459ffc935 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:15.822511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac490be-30a3-41ad-b53c-70a459ffc935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:15.840768 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-fac490be-30a3-41ad-b53c-70a459ffc935 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:15.842140 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-fac490be-30a3-41ad-b53c-70a459ffc935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:15.915608 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 274/533] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:16.239158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4ab31-f396-4ac0-854d-bd1f098a53f6 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.239512 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4ab31-f396-4ac0-854d-bd1f098a53f6 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.239698 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4ab31-f396-4ac0-854d-bd1f098a53f6 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.241302 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 260/534] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:16.246533 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cf91d-2ed1-49f7-b05e-f61a78a0ecf3 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.246818 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cf91d-2ed1-49f7-b05e-f61a78a0ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.247093 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cf91d-2ed1-49f7-b05e-f61a78a0ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.253576 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4ab31-f396-4ac0-854d-bd1f098a53f6 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:16.268925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-486cf91d-2ed1-49f7-b05e-f61a78a0ecf3 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:16.271033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-486cf91d-2ed1-49f7-b05e-f61a78a0ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:16.272683 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:16.301459 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:16.370359 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 275/535] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:16.375497 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4ab31-f396-4ac0-854d-bd1f098a53f6 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:16.412445 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda5b7a-5786-402b-9880-cf7329487a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:16.413447 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda5b7a-5786-402b-9880-cf7329487a77 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.413920 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda5b7a-5786-402b-9880-cf7329487a77 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.414439 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda5b7a-5786-402b-9880-cf7329487a77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.425773 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda5b7a-5786-402b-9880-cf7329487a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-bcda5b7a-5786-402b-9880-cf7329487a77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:16.430757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:16.431636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:16.432427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:16.435025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 261/536] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:16.441102 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cf91d-2ed1-49f7-b05e-f61a78a0ecf3 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:16.481962 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5380-f85e-4cda-8f55-4bdf4e17b72c None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.482883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5380-f85e-4cda-8f55-4bdf4e17b72c None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.483164 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5380-f85e-4cda-8f55-4bdf4e17b72c None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.488329 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 262/537] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:16.489857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85146-e2dd-436c-9170-c2916f43e1fe None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.490238 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85146-e2dd-436c-9170-c2916f43e1fe None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.490512 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85146-e2dd-436c-9170-c2916f43e1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.509592 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-51d85146-e2dd-436c-9170-c2916f43e1fe None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:16.510975 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-51d85146-e2dd-436c-9170-c2916f43e1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:16.559329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cf91d-2ed1-49f7-b05e-f61a78a0ecf3 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:16.594034 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 263/538] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:16.612233 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2129c2-3dbe-40b5-b1a6-4f0bb055349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:16.613279 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2129c2-3dbe-40b5-b1a6-4f0bb055349c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.613777 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2129c2-3dbe-40b5-b1a6-4f0bb055349c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.614291 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2129c2-3dbe-40b5-b1a6-4f0bb055349c None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.615263 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2129c2-3dbe-40b5-b1a6-4f0bb055349c None admin] RBAC: Adding query filter params (name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:16.615762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2129c2-3dbe-40b5-b1a6-4f0bb055349c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:16.617703 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2129c2-3dbe-40b5-b1a6-4f0bb055349c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:16.629207 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 276/539] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:16.635260 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d85146-e2dd-436c-9170-c2916f43e1fe None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:16.645364 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:16.737985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2129c2-3dbe-40b5-b1a6-4f0bb055349c None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:16.757003 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d85146-e2dd-436c-9170-c2916f43e1fe None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:16.761215 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:16.793830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb1076-564c-4762-8ece-6c045aa8cd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:16.794567 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb1076-564c-4762-8ece-6c045aa8cd56 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.794840 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb1076-564c-4762-8ece-6c045aa8cd56 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.795101 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb1076-564c-4762-8ece-6c045aa8cd56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.806309 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb1076-564c-4762-8ece-6c045aa8cd56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:16.807866 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb1076-564c-4762-8ece-6c045aa8cd56 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-0dfb1076-564c-4762-8ece-6c045aa8cd56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:16.822125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:16.823514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:16.824383 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:16.824383 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:16.824383 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:16.824383 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 264/540] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:16.825275 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bc003-822d-45d6-93f1-89718afccbd6 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.825387 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bc003-822d-45d6-93f1-89718afccbd6 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.825738 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bc003-822d-45d6-93f1-89718afccbd6 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.826979 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 265/541] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:16.830840 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bc003-822d-45d6-93f1-89718afccbd6 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:16.850810 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2129c2-3dbe-40b5-b1a6-4f0bb055349c None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:16.885619 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cf51f-5b53-48ff-8e7b-4902f256cfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:16.886274 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cf51f-5b53-48ff-8e7b-4902f256cfda None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.886548 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cf51f-5b53-48ff-8e7b-4902f256cfda None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.886811 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cf51f-5b53-48ff-8e7b-4902f256cfda None admin] PATH_INFO: `/v3/roles/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.893834 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:16.897574 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cf51f-5b53-48ff-8e7b-4902f256cfda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-d43cf51f-5b53-48ff-8e7b-4902f256cfda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:16.904438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:16.905329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:16.906885 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 277/542] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:16.908281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b40c7-7b5b-423f-8df9-5da115e00d11 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.908531 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b40c7-7b5b-423f-8df9-5da115e00d11 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.908800 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b40c7-7b5b-423f-8df9-5da115e00d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.930881 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-3e0b40c7-7b5b-423f-8df9-5da115e00d11 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:16.932083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-3e0b40c7-7b5b-423f-8df9-5da115e00d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:16.949379 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bc003-822d-45d6-93f1-89718afccbd6 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:16.985162 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1e27d-41c9-47e8-b04b-96de5699d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:16.985770 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1e27d-41c9-47e8-b04b-96de5699d5fc None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.986111 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1e27d-41c9-47e8-b04b-96de5699d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.986386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1e27d-41c9-47e8-b04b-96de5699d5fc None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.987021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1e27d-41c9-47e8-b04b-96de5699d5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:16.987317 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1e27d-41c9-47e8-b04b-96de5699d5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:16.988756 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1e27d-41c9-47e8-b04b-96de5699d5fc None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:16.999401 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 278/543] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:17.000258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b40c7-7b5b-423f-8df9-5da115e00d11 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.011224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 266/544] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:17.012311 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1e27d-41c9-47e8-b04b-96de5699d5fc None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.017005 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:17.119143 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b40c7-7b5b-423f-8df9-5da115e00d11 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.127744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1e27d-41c9-47e8-b04b-96de5699d5fc None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.146009 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:17.155209 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17a2d-8997-40df-8646-35cc286a94e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.155820 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17a2d-8997-40df-8646-35cc286a94e2 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.156089 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17a2d-8997-40df-8646-35cc286a94e2 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.156348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17a2d-8997-40df-8646-35cc286a94e2 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.157033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e17a2d-8997-40df-8646-35cc286a94e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:17.157294 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e17a2d-8997-40df-8646-35cc286a94e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:17.158694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e17a2d-8997-40df-8646-35cc286a94e2 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:17.164836 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207b1e1-9696-4cb2-8c76-cea036cc4714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.165465 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b1e1-9696-4cb2-8c76-cea036cc4714 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.165740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b1e1-9696-4cb2-8c76-cea036cc4714 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.166392 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b1e1-9696-4cb2-8c76-cea036cc4714 None admin] PATH_INFO: `/v3/roles/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.167771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 279/545] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:17.168449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17a2d-8997-40df-8646-35cc286a94e2 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.182020 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207b1e1-9696-4cb2-8c76-cea036cc4714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-9207b1e1-9696-4cb2-8c76-cea036cc4714 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:17.187112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:17.188750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 267/546] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:17.189614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207b1e1-9696-4cb2-8c76-cea036cc4714 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.252815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:17.285251 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17a2d-8997-40df-8646-35cc286a94e2 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.298263 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207b1e1-9696-4cb2-8c76-cea036cc4714 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.323428 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40673d-29c8-4552-b227-92c262546a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.324067 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40673d-29c8-4552-b227-92c262546a8f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.324343 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40673d-29c8-4552-b227-92c262546a8f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.324675 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40673d-29c8-4552-b227-92c262546a8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.332190 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448a284-67c5-45a1-b647-b7cb4e9f9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.332810 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448a284-67c5-45a1-b647-b7cb4e9f9c19 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.332958 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40673d-29c8-4552-b227-92c262546a8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:17.333079 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448a284-67c5-45a1-b647-b7cb4e9f9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.333343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448a284-67c5-45a1-b647-b7cb4e9f9c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.334448 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40673d-29c8-4552-b227-92c262546a8f None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-8f40673d-29c8-4552-b227-92c262546a8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:17.345543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:17.346657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:17.347577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:17.347577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:17.347577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:17.347577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:17.347577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:17.347577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:17.347577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:17.347577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:17.347577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:17.347577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:17.348073 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448a284-67c5-45a1-b647-b7cb4e9f9c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:17.348142 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 280/547] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:17.348213 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448a284-67c5-45a1-b647-b7cb4e9f9c19 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:17.348287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40673d-29c8-4552-b227-92c262546a8f None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-a448a284-67c5-45a1-b647-b7cb4e9f9c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:17.364919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:17.365880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:17.366759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:17.366759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:17.366759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:17.366759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 268/548] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:17.367024 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448a284-67c5-45a1-b647-b7cb4e9f9c19 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.397522 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:17.456207 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40673d-29c8-4552-b227-92c262546a8f None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.468622 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448a284-67c5-45a1-b647-b7cb4e9f9c19 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.484927 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:17.490417 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57704710-d674-4b76-9eb3-64ff303c90d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.491017 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704710-d674-4b76-9eb3-64ff303c90d3 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.491273 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704710-d674-4b76-9eb3-64ff303c90d3 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.491538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704710-d674-4b76-9eb3-64ff303c90d3 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.492187 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57704710-d674-4b76-9eb3-64ff303c90d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:17.492770 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57704710-d674-4b76-9eb3-64ff303c90d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:17.493846 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57704710-d674-4b76-9eb3-64ff303c90d3 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:17.501936 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 281/549] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:17.502574 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57704710-d674-4b76-9eb3-64ff303c90d3 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.506893 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f8b75-679e-4e5f-8dab-9f7b7276f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.507475 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8b75-679e-4e5f-8dab-9f7b7276f505 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.507753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8b75-679e-4e5f-8dab-9f7b7276f505 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.508026 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8b75-679e-4e5f-8dab-9f7b7276f505 None admin] PATH_INFO: `/v3/roles/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.518566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f8b75-679e-4e5f-8dab-9f7b7276f505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-1f1f8b75-679e-4e5f-8dab-9f7b7276f505 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:17.523743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:17.524827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 269/550] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:17.525791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f8b75-679e-4e5f-8dab-9f7b7276f505 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.606523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57704710-d674-4b76-9eb3-64ff303c90d3 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.617427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:17.628090 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f8b75-679e-4e5f-8dab-9f7b7276f505 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.641200 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37a21-fb49-4604-b052-0bf8b8cfc11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.641807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37a21-fb49-4604-b052-0bf8b8cfc11f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.642124 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37a21-fb49-4604-b052-0bf8b8cfc11f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.642399 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37a21-fb49-4604-b052-0bf8b8cfc11f None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.643122 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37a21-fb49-4604-b052-0bf8b8cfc11f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:17.643431 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37a21-fb49-4604-b052-0bf8b8cfc11f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:17.645036 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37a21-fb49-4604-b052-0bf8b8cfc11f None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:17.663566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece1993-e8e3-4d3a-b481-77249591c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.664183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece1993-e8e3-4d3a-b481-77249591c09c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.664456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece1993-e8e3-4d3a-b481-77249591c09c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.664711 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece1993-e8e3-4d3a-b481-77249591c09c None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.665380 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece1993-e8e3-4d3a-b481-77249591c09c None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:17.665675 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece1993-e8e3-4d3a-b481-77249591c09c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:17.667445 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece1993-e8e3-4d3a-b481-77249591c09c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:17.668317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 282/551] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:17.669144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37a21-fb49-4604-b052-0bf8b8cfc11f None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.680684 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 270/552] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:17.681488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece1993-e8e3-4d3a-b481-77249591c09c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.725220 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:17.771756 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37a21-fb49-4604-b052-0bf8b8cfc11f None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.780976 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece1993-e8e3-4d3a-b481-77249591c09c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.806578 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcb865-41d6-4142-b2d0-7df4ea73328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.807213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcb865-41d6-4142-b2d0-7df4ea73328a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.807490 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcb865-41d6-4142-b2d0-7df4ea73328a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.807759 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcb865-41d6-4142-b2d0-7df4ea73328a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.814026 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20c76e-d504-4c52-a68c-9f2cca7a7140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.814616 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c76e-d504-4c52-a68c-9f2cca7a7140 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.814888 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c76e-d504-4c52-a68c-9f2cca7a7140 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.815153 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c76e-d504-4c52-a68c-9f2cca7a7140 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.815802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20c76e-d504-4c52-a68c-9f2cca7a7140 None admin] RBAC: Adding query filter params (name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:17.816097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20c76e-d504-4c52-a68c-9f2cca7a7140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:17.817467 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20c76e-d504-4c52-a68c-9f2cca7a7140 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:17.818121 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcb865-41d6-4142-b2d0-7df4ea73328a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:17.820066 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcb865-41d6-4142-b2d0-7df4ea73328a None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:17.825335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 271/553] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:17.826377 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20c76e-d504-4c52-a68c-9f2cca7a7140 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-d4dcb865-41d6-4142-b2d0-7df4ea73328a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:17.835960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:17.837105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:17.838078 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:17.838078 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:17.838078 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:17.838078 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 283/554] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:17.838078 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcb865-41d6-4142-b2d0-7df4ea73328a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:17.845050 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:17.934965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20c76e-d504-4c52-a68c-9f2cca7a7140 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.942724 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcb865-41d6-4142-b2d0-7df4ea73328a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:17.945404 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:17.969322 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1e2fb-6b64-42a4-8c17-147bf169e411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.969944 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1e2fb-6b64-42a4-8c17-147bf169e411 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.970251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1e2fb-6b64-42a4-8c17-147bf169e411 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.970519 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1e2fb-6b64-42a4-8c17-147bf169e411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.979840 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19771a65-f9dc-4f29-8b79-a11a30d991ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:17.980444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771a65-f9dc-4f29-8b79-a11a30d991ad None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:17.980714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771a65-f9dc-4f29-8b79-a11a30d991ad None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:17.980964 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1e2fb-6b64-42a4-8c17-147bf169e411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:17.981063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771a65-f9dc-4f29-8b79-a11a30d991ad None admin] PATH_INFO: `/v3/users/glance` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:17.982477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1e2fb-6b64-42a4-8c17-147bf169e411 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:17.988414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19771a65-f9dc-4f29-8b79-a11a30d991ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:17.989907 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19771a65-f9dc-4f29-8b79-a11a30d991ad None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-8ad1e2fb-6b64-42a4-8c17-147bf169e411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:17.996811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:17.997882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:17.998864 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:17.998864 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:17.998864 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:17.998864 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 272/555] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:17.999524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1e2fb-6b64-42a4-8c17-147bf169e411 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-19771a65-f9dc-4f29-8b79-a11a30d991ad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:18.001803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:18.002923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 284/556] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:18.004763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19771a65-f9dc-4f29-8b79-a11a30d991ad None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.065082 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:18.105952 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1e2fb-6b64-42a4-8c17-147bf169e411 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:18.114892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19771a65-f9dc-4f29-8b79-a11a30d991ad None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:18.139783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0ad33-9bed-43bd-ab1b-f39c9ee708e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:18.140611 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0ad33-9bed-43bd-ab1b-f39c9ee708e5 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:18.140891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0ad33-9bed-43bd-ab1b-f39c9ee708e5 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:18.141157 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0ad33-9bed-43bd-ab1b-f39c9ee708e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:18.147812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7599a07-c436-4281-bf77-22224100f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:18.148416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599a07-c436-4281-bf77-22224100f9fa None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:18.148691 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599a07-c436-4281-bf77-22224100f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:18.148962 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599a07-c436-4281-bf77-22224100f9fa None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:18.149597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7599a07-c436-4281-bf77-22224100f9fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:18.149918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7599a07-c436-4281-bf77-22224100f9fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:18.151309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7599a07-c436-4281-bf77-22224100f9fa None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:18.151798 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0ad33-9bed-43bd-ab1b-f39c9ee708e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:18.153225 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0ad33-9bed-43bd-ab1b-f39c9ee708e5 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:18.163493 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 285/557] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:18.164291 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7599a07-c436-4281-bf77-22224100f9fa None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-7cd0ad33-9bed-43bd-ab1b-f39c9ee708e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:18.167895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:18.169647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:18.171240 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:18.171240 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:18.171240 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:18.171240 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 273/558] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:18.171240 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0ad33-9bed-43bd-ab1b-f39c9ee708e5 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.194071 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:18.271974 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7599a07-c436-4281-bf77-22224100f9fa None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:18.272219 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0ad33-9bed-43bd-ab1b-f39c9ee708e5 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:18.288715 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:18.305479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84453229-0549-4754-93e0-66c753afdc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:18.306126 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84453229-0549-4754-93e0-66c753afdc60 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:18.306413 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84453229-0549-4754-93e0-66c753afdc60 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:18.306697 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84453229-0549-4754-93e0-66c753afdc60 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:18.307331 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84453229-0549-4754-93e0-66c753afdc60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:18.307631 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84453229-0549-4754-93e0-66c753afdc60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:18.307973 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5a69e-2e5b-4b11-aed2-80b9627e7cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:18.308572 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a69e-2e5b-4b11-aed2-80b9627e7cb8 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:18.308853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a69e-2e5b-4b11-aed2-80b9627e7cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:18.309017 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84453229-0549-4754-93e0-66c753afdc60 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:18.309126 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a69e-2e5b-4b11-aed2-80b9627e7cb8 None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:18.309825 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5a69e-2e5b-4b11-aed2-80b9627e7cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:18.310656 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5a69e-2e5b-4b11-aed2-80b9627e7cb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:18.312083 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5a69e-2e5b-4b11-aed2-80b9627e7cb8 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:18.324655 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 286/559] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:18.324655 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84453229-0549-4754-93e0-66c753afdc60 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.330679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 274/560] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 19:24:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:18.331365 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5a69e-2e5b-4b11-aed2-80b9627e7cb8 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.419115 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:18.437431 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84453229-0549-4754-93e0-66c753afdc60 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:18.439540 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5a69e-2e5b-4b11-aed2-80b9627e7cb8 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:18.472577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0c76-5e0e-45ed-a112-7528bafc986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:18.473206 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0c76-5e0e-45ed-a112-7528bafc986b None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:18.473444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107145fa-3c38-4cfd-abae-1a4f57fa3856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:18.473562 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0c76-5e0e-45ed-a112-7528bafc986b None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:18.473738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0c76-5e0e-45ed-a112-7528bafc986b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:18.474144 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107145fa-3c38-4cfd-abae-1a4f57fa3856 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:18.474422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107145fa-3c38-4cfd-abae-1a4f57fa3856 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:18.474697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107145fa-3c38-4cfd-abae-1a4f57fa3856 None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:18.475321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107145fa-3c38-4cfd-abae-1a4f57fa3856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:18.475619 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107145fa-3c38-4cfd-abae-1a4f57fa3856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:18.477007 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107145fa-3c38-4cfd-abae-1a4f57fa3856 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:18.481352 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc0c76-5e0e-45ed-a112-7528bafc986b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:18.483053 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc0c76-5e0e-45ed-a112-7528bafc986b None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:18.488123 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 275/561] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:18.488916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107145fa-3c38-4cfd-abae-1a4f57fa3856 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-74dc0c76-5e0e-45ed-a112-7528bafc986b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:18.494368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:18.495479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:18.496636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:18.496636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:18.496636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:18.496636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:18.496636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:18.496636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:18.496636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:18.496636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:18.496636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:24:18.496636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:18.500232 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 287/562] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:24:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:18.501070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0c76-5e0e-45ed-a112-7528bafc986b None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.530656 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:18.599100 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107145fa-3c38-4cfd-abae-1a4f57fa3856 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:18.616714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0c76-5e0e-45ed-a112-7528bafc986b None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:18.635621 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5b7b5-0220-46a6-a6df-6f32427cd9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:18.636334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5b7b5-0220-46a6-a6df-6f32427cd9e8 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:18.636675 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5b7b5-0220-46a6-a6df-6f32427cd9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:18.637008 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5b7b5-0220-46a6-a6df-6f32427cd9e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:18.646307 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5b7b5-0220-46a6-a6df-6f32427cd9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:18.648480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5b7b5-0220-46a6-a6df-6f32427cd9e8 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:18.651877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a26543-c5a3-4384-b160-b9c6e297a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:18.652511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26543-c5a3-4384-b160-b9c6e297a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:18.652787 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26543-c5a3-4384-b160-b9c6e297a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:18.653055 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26543-c5a3-4384-b160-b9c6e297a1c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-10c5b7b5-0220-46a6-a6df-6f32427cd9e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:18.663176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:18.664437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:18.666728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:18.666728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:18.666728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:18.666728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:18.666728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:18.666728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:18.666728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:18.666728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:18.666728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 276/563] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:18.666728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5b7b5-0220-46a6-a6df-6f32427cd9e8 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.678365 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a26543-c5a3-4384-b160-b9c6e297a1c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:18.679909 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a26543-c5a3-4384-b160-b9c6e297a1c5 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:18.691016 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-85a26543-c5a3-4384-b160-b9c6e297a1c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:18.710083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:18.711308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:18.712378 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:18.712378 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:18.712378 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:18.714152 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 288/564] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:18.715193 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a26543-c5a3-4384-b160-b9c6e297a1c5 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.785676 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:18.794253 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5b7b5-0220-46a6-a6df-6f32427cd9e8 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:18.827500 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a26543-c5a3-4384-b160-b9c6e297a1c5 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:18.830795 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dfdb0-963f-4a70-9fd7-f5c58b1b8c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:18.830795 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dfdb0-963f-4a70-9fd7-f5c58b1b8c8a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:18.831354 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dfdb0-963f-4a70-9fd7-f5c58b1b8c8a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:18.831354 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dfdb0-963f-4a70-9fd7-f5c58b1b8c8a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:18.839158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dfdb0-963f-4a70-9fd7-f5c58b1b8c8a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:18.840599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dfdb0-963f-4a70-9fd7-f5c58b1b8c8a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-ec6dfdb0-963f-4a70-9fd7-f5c58b1b8c8a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:18.852304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:18.853242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 277/565] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:18.854736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dfdb0-963f-4a70-9fd7-f5c58b1b8c8a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.869012 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d458ca8-a366-4a24-a6b0-40be5eae72ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:18.869480 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d458ca8-a366-4a24-a6b0-40be5eae72ef None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:18.869832 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d458ca8-a366-4a24-a6b0-40be5eae72ef None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:18.870217 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d458ca8-a366-4a24-a6b0-40be5eae72ef None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:18.871045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d458ca8-a366-4a24-a6b0-40be5eae72ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:18.871318 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d458ca8-a366-4a24-a6b0-40be5eae72ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:18.874580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d458ca8-a366-4a24-a6b0-40be5eae72ef None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:18.890685 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 289/566] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 19:24:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:18.891505 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d458ca8-a366-4a24-a6b0-40be5eae72ef None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:18.946889 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:18.965781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dfdb0-963f-4a70-9fd7-f5c58b1b8c8a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:18.995616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d458ca8-a366-4a24-a6b0-40be5eae72ef None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.002356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32478b-1bfe-46c9-87f3-402ff5f8a6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.002961 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32478b-1bfe-46c9-87f3-402ff5f8a6ce None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.003232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32478b-1bfe-46c9-87f3-402ff5f8a6ce None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.003498 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32478b-1bfe-46c9-87f3-402ff5f8a6ce None admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.004185 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32478b-1bfe-46c9-87f3-402ff5f8a6ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:19.004485 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32478b-1bfe-46c9-87f3-402ff5f8a6ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.005932 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32478b-1bfe-46c9-87f3-402ff5f8a6ce None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.019518 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 278/567] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:19.024649 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32478b-1bfe-46c9-87f3-402ff5f8a6ce None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.035417 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fb570-cae3-4de6-8da2-bf3c15184ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.036036 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fb570-cae3-4de6-8da2-bf3c15184ba0 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.036313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fb570-cae3-4de6-8da2-bf3c15184ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.036572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fb570-cae3-4de6-8da2-bf3c15184ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.037209 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fb570-cae3-4de6-8da2-bf3c15184ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:19.037510 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fb570-cae3-4de6-8da2-bf3c15184ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.038932 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fb570-cae3-4de6-8da2-bf3c15184ba0 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.039833 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:19.052317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 290/568] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:19.052973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fb570-cae3-4de6-8da2-bf3c15184ba0 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.127726 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32478b-1bfe-46c9-87f3-402ff5f8a6ce None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.157938 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fb570-cae3-4de6-8da2-bf3c15184ba0 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.162390 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93887cda-4f89-4386-93d8-9295c9b0f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.162992 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93887cda-4f89-4386-93d8-9295c9b0f135 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.163261 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93887cda-4f89-4386-93d8-9295c9b0f135 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.163523 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93887cda-4f89-4386-93d8-9295c9b0f135 None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.164234 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93887cda-4f89-4386-93d8-9295c9b0f135 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:19.164531 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93887cda-4f89-4386-93d8-9295c9b0f135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.166350 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93887cda-4f89-4386-93d8-9295c9b0f135 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.173432 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:19.183687 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 279/569] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Aug 19 19:24:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:19.184526 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93887cda-4f89-4386-93d8-9295c9b0f135 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.195213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29de0a6-3282-4e22-9954-5b791bf62c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.196078 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29de0a6-3282-4e22-9954-5b791bf62c78 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.196188 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29de0a6-3282-4e22-9954-5b791bf62c78 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.196370 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29de0a6-3282-4e22-9954-5b791bf62c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.207495 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29de0a6-3282-4e22-9954-5b791bf62c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.208962 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29de0a6-3282-4e22-9954-5b791bf62c78 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-d29de0a6-3282-4e22-9954-5b791bf62c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:19.223504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:19.224590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:19.225635 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:19.225635 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:19.225635 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:19.226131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 291/570] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:19.227236 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29de0a6-3282-4e22-9954-5b791bf62c78 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.258048 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:19.287763 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93887cda-4f89-4386-93d8-9295c9b0f135 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.321500 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c02e4-a37f-4805-b4cb-5d6eab9eafd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.322179 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c02e4-a37f-4805-b4cb-5d6eab9eafd6 None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.322453 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c02e4-a37f-4805-b4cb-5d6eab9eafd6 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.322726 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c02e4-a37f-4805-b4cb-5d6eab9eafd6 None admin] PATH_INFO: `/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/ff0c7740e6814c6c9515d0aed78bba68/roles/db8abf37adff4704889523e773b95924` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.325429 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29de0a6-3282-4e22-9954-5b791bf62c78 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.337190 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c02e4-a37f-4805-b4cb-5d6eab9eafd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a186fc1651b442d4b704b88a3dddf1b0, user_id=ff0c7740e6814c6c9515d0aed78bba68, role_id=db8abf37adff4704889523e773b95924)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.338699 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c02e4-a37f-4805-b4cb-5d6eab9eafd6 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.352051 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 280/571] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:24:19 2022] PUT /identity/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/ff0c7740e6814c6c9515d0aed78bba68/roles/db8abf37adff4704889523e773b95924 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:24:19.352937 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c02e4-a37f-4805-b4cb-5d6eab9eafd6 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.372641 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e1fb0-4af8-4f6e-ac6b-0f7d46259e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.373306 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e1fb0-4af8-4f6e-ac6b-0f7d46259e20 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.373595 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e1fb0-4af8-4f6e-ac6b-0f7d46259e20 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.373857 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e1fb0-4af8-4f6e-ac6b-0f7d46259e20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.382702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e1fb0-4af8-4f6e-ac6b-0f7d46259e20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.384129 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e1fb0-4af8-4f6e-ac6b-0f7d46259e20 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-893e1fb0-4af8-4f6e-ac6b-0f7d46259e20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:19.397937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:19.398988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:19.399929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:19.399929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:19.399929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:19.399929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:19.399929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:19.399929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:19.399929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:19.399929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:19.399929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 292/572] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:19.400450 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e1fb0-4af8-4f6e-ac6b-0f7d46259e20 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.435088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:19.475552 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c02e4-a37f-4805-b4cb-5d6eab9eafd6 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.502389 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:19.517859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5d4d9-df4b-4896-8186-5f1243609869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.518606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5d4d9-df4b-4896-8186-5f1243609869 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.518887 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5d4d9-df4b-4896-8186-5f1243609869 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.519155 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5d4d9-df4b-4896-8186-5f1243609869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.519326 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e1fb0-4af8-4f6e-ac6b-0f7d46259e20 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.531666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5d4d9-df4b-4896-8186-5f1243609869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.533108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5d4d9-df4b-4896-8186-5f1243609869 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-25b5d4d9-df4b-4896-8186-5f1243609869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:19.553513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:19.554646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:19.555529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:19.555529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:19.555529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:19.555529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 281/573] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:19.556187 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5d4d9-df4b-4896-8186-5f1243609869 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.562522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5aada1-a40e-4dae-8bd7-44d96928deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.563141 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aada1-a40e-4dae-8bd7-44d96928deeb None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.563419 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aada1-a40e-4dae-8bd7-44d96928deeb None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.563691 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aada1-a40e-4dae-8bd7-44d96928deeb None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.564338 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5aada1-a40e-4dae-8bd7-44d96928deeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:19.564641 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5aada1-a40e-4dae-8bd7-44d96928deeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.566084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5aada1-a40e-4dae-8bd7-44d96928deeb None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.580071 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 293/574] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:19.580734 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5aada1-a40e-4dae-8bd7-44d96928deeb None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.667051 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5d4d9-df4b-4896-8186-5f1243609869 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.669872 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:19.686575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5aada1-a40e-4dae-8bd7-44d96928deeb None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.705496 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f82796-d823-429f-a311-a25fbe61acd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.706155 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f82796-d823-429f-a311-a25fbe61acd7 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.706429 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f82796-d823-429f-a311-a25fbe61acd7 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.706789 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f82796-d823-429f-a311-a25fbe61acd7 None admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.707483 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f82796-d823-429f-a311-a25fbe61acd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:19.707834 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f82796-d823-429f-a311-a25fbe61acd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.709330 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f82796-d823-429f-a311-a25fbe61acd7 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.727325 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 282/575] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:19.727325 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f82796-d823-429f-a311-a25fbe61acd7 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.733610 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72332ac-2f06-4c0e-843f-618aba053bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.734349 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72332ac-2f06-4c0e-843f-618aba053bd4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.734692 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72332ac-2f06-4c0e-843f-618aba053bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.735025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72332ac-2f06-4c0e-843f-618aba053bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.735786 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72332ac-2f06-4c0e-843f-618aba053bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:19.736153 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72332ac-2f06-4c0e-843f-618aba053bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.737618 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72332ac-2f06-4c0e-843f-618aba053bd4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.750201 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 294/576] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:19.751100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72332ac-2f06-4c0e-843f-618aba053bd4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.765162 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:19.833493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f82796-d823-429f-a311-a25fbe61acd7 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.859919 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72332ac-2f06-4c0e-843f-618aba053bd4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.869284 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ca395-ec35-47e4-9e71-f50e3ac5b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.869952 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ca395-ec35-47e4-9e71-f50e3ac5b742 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.870354 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ca395-ec35-47e4-9e71-f50e3ac5b742 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.870673 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ca395-ec35-47e4-9e71-f50e3ac5b742 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.877642 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ca395-ec35-47e4-9e71-f50e3ac5b742 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.879200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ca395-ec35-47e4-9e71-f50e3ac5b742 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-9d5ca395-ec35-47e4-9e71-f50e3ac5b742 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:19.892366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:19.893451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:19.899072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:19.899072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:19.899072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:19.899072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:19.899072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:19.899072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:19.899072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:19.899072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:19.899072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 283/577] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:19.899072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ca395-ec35-47e4-9e71-f50e3ac5b742 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.899724 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce57df4-9472-46da-8ab4-0dfc47d34ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.899724 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce57df4-9472-46da-8ab4-0dfc47d34ba9 None admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.899724 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce57df4-9472-46da-8ab4-0dfc47d34ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.899724 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce57df4-9472-46da-8ab4-0dfc47d34ba9 None admin] PATH_INFO: `/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/5f36f349d532411ba09da3231aef3f1b/roles/db8abf37adff4704889523e773b95924` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.919384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce57df4-9472-46da-8ab4-0dfc47d34ba9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a186fc1651b442d4b704b88a3dddf1b0, user_id=5f36f349d532411ba09da3231aef3f1b, role_id=db8abf37adff4704889523e773b95924)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.921547 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce57df4-9472-46da-8ab4-0dfc47d34ba9 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.926898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:19.938674 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 295/578] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:24:19 2022] PUT /identity/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/5f36f349d532411ba09da3231aef3f1b/roles/db8abf37adff4704889523e773b95924 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:24:19.942978 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce57df4-9472-46da-8ab4-0dfc47d34ba9 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:20.034667 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:20.047076 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ca395-ec35-47e4-9e71-f50e3ac5b742 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:20.085512 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5243d2-8ef5-4496-95b8-028df7bc4b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:20.086504 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5243d2-8ef5-4496-95b8-028df7bc4b4a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:20.086952 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5243d2-8ef5-4496-95b8-028df7bc4b4a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:20.087358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5243d2-8ef5-4496-95b8-028df7bc4b4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:20.097472 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5243d2-8ef5-4496-95b8-028df7bc4b4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:20.099250 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5243d2-8ef5-4496-95b8-028df7bc4b4a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:20.112111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce57df4-9472-46da-8ab4-0dfc47d34ba9 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-cd5243d2-8ef5-4496-95b8-028df7bc4b4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:20.116355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:20.117405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:20.118599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:20.118599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:20.118599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:20.118599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:20.118599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:20.118599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:20.118599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:20.118599 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:20.125352 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 284/579] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:20.127345 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5243d2-8ef5-4496-95b8-028df7bc4b4a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:20.163960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0729e2f-e70c-49ee-b3e4-17a97942efb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:20.165342 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0729e2f-e70c-49ee-b3e4-17a97942efb1 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:20.166328 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0729e2f-e70c-49ee-b3e4-17a97942efb1 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:20.166840 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0729e2f-e70c-49ee-b3e4-17a97942efb1 None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:20.167669 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0729e2f-e70c-49ee-b3e4-17a97942efb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:20.168238 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0729e2f-e70c-49ee-b3e4-17a97942efb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:20.170595 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0729e2f-e70c-49ee-b3e4-17a97942efb1 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:20.186826 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 296/580] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:20.194782 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0729e2f-e70c-49ee-b3e4-17a97942efb1 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:20.272565 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:20.279153 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5243d2-8ef5-4496-95b8-028df7bc4b4a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:20.316061 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3190d48-09c7-40b3-a90e-999f0006baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:20.316675 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190d48-09c7-40b3-a90e-999f0006baea None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:20.316945 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190d48-09c7-40b3-a90e-999f0006baea None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:20.317209 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190d48-09c7-40b3-a90e-999f0006baea None admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:20.317901 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3190d48-09c7-40b3-a90e-999f0006baea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:20.318234 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3190d48-09c7-40b3-a90e-999f0006baea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:20.319698 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3190d48-09c7-40b3-a90e-999f0006baea None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:20.329135 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0729e2f-e70c-49ee-b3e4-17a97942efb1 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:20.338069 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 285/581] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:20.339069 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3190d48-09c7-40b3-a90e-999f0006baea None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:20.356347 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:20.369228 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4858f49-6f4c-4a48-892b-2b160984bef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:20.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4858f49-6f4c-4a48-892b-2b160984bef3 None admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:20.370940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4858f49-6f4c-4a48-892b-2b160984bef3 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:20.371458 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4858f49-6f4c-4a48-892b-2b160984bef3 None admin] PATH_INFO: `/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/d19d16bc47614980b4f6d57e39a0f4b3/roles/db8abf37adff4704889523e773b95924` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:20.388667 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4858f49-6f4c-4a48-892b-2b160984bef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a186fc1651b442d4b704b88a3dddf1b0, user_id=d19d16bc47614980b4f6d57e39a0f4b3, role_id=db8abf37adff4704889523e773b95924)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:20.390725 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4858f49-6f4c-4a48-892b-2b160984bef3 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:20.410760 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 297/582] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:24:20 2022] PUT /identity/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/d19d16bc47614980b4f6d57e39a0f4b3/roles/db8abf37adff4704889523e773b95924 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:24:20.467847 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3190d48-09c7-40b3-a90e-999f0006baea None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:20.519671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5bfc0-41b2-4090-931b-d4eb3c67ea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:20.521448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5bfc0-41b2-4090-931b-d4eb3c67ea93 None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:20.521448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5bfc0-41b2-4090-931b-d4eb3c67ea93 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:20.521448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5bfc0-41b2-4090-931b-d4eb3c67ea93 None admin] PATH_INFO: `/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/3ba4a0ad60a549bd8255124ffcd83f30/roles/db8abf37adff4704889523e773b95924` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:20.539021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5bfc0-41b2-4090-931b-d4eb3c67ea93 None admin] RBAC: Authorizing `identity:create_grant(project_id=a186fc1651b442d4b704b88a3dddf1b0, user_id=3ba4a0ad60a549bd8255124ffcd83f30, role_id=db8abf37adff4704889523e773b95924)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:20.540651 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5bfc0-41b2-4090-931b-d4eb3c67ea93 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:20.559958 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 286/583] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:24:20 2022] PUT /identity/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/3ba4a0ad60a549bd8255124ffcd83f30/roles/db8abf37adff4704889523e773b95924 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:24:21.629447 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce56b60-05b6-4926-a8d3-93e6329e4580 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:21.629973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce56b60-05b6-4926-a8d3-93e6329e4580 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:21.629973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce56b60-05b6-4926-a8d3-93e6329e4580 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:21.631629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 298/584] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:21.637065 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a462857-afcf-4e5d-97b2-85b4aca88c03 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:21.637455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a462857-afcf-4e5d-97b2-85b4aca88c03 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:21.637616 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a462857-afcf-4e5d-97b2-85b4aca88c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:21.656415 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-8a462857-afcf-4e5d-97b2-85b4aca88c03 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:21.657622 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-8a462857-afcf-4e5d-97b2-85b4aca88c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:21.732454 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:21.750173 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 287/585] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:22.087275 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce56b60-05b6-4926-a8d3-93e6329e4580 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:22.212556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce56b60-05b6-4926-a8d3-93e6329e4580 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:22.221665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:22.251200 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9f296-0c65-452f-a515-85df4d6a4521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:22.251863 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9f296-0c65-452f-a515-85df4d6a4521 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:22.252143 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9f296-0c65-452f-a515-85df4d6a4521 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:22.252439 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9f296-0c65-452f-a515-85df4d6a4521 None admin] PATH_INFO: `/v3/roles/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:22.263821 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9f296-0c65-452f-a515-85df4d6a4521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-4ee9f296-0c65-452f-a515-85df4d6a4521 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:22.268722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:22.270806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:22.272061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 299/586] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:22.272929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d54e7-ac3f-4ad8-a065-69c52928e0e7 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:22.272929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d54e7-ac3f-4ad8-a065-69c52928e0e7 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:22.272929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d54e7-ac3f-4ad8-a065-69c52928e0e7 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:22.277048 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 288/587] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:22.278692 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9f296-0c65-452f-a515-85df4d6a4521 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:22.284176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4d362-b3d0-4993-a81c-443c47c7c16a None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:22.284176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4d362-b3d0-4993-a81c-443c47c7c16a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:22.284176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4d362-b3d0-4993-a81c-443c47c7c16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:22.302934 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-fec4d362-b3d0-4993-a81c-443c47c7c16a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:22.304140 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-fec4d362-b3d0-4993-a81c-443c47c7c16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:22.390182 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 289/588] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:24:22.403252 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9f296-0c65-452f-a515-85df4d6a4521 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:22.439615 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3499057-8ad0-4051-9345-6ea550ac33f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:22.440620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3499057-8ad0-4051-9345-6ea550ac33f4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:22.441099 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3499057-8ad0-4051-9345-6ea550ac33f4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:22.441570 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3499057-8ad0-4051-9345-6ea550ac33f4 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:22.442471 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3499057-8ad0-4051-9345-6ea550ac33f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:22.443019 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3499057-8ad0-4051-9345-6ea550ac33f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:22.444590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3499057-8ad0-4051-9345-6ea550ac33f4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:22.453785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 300/589] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:22.463125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4d362-b3d0-4993-a81c-443c47c7c16a None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:22.569856 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4d362-b3d0-4993-a81c-443c47c7c16a None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:22.598717 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:22.610471 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1ac65-2c3f-41f0-88a4-1f62b363fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:22.611435 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1ac65-2c3f-41f0-88a4-1f62b363fc65 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:22.611908 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1ac65-2c3f-41f0-88a4-1f62b363fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:22.612403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1ac65-2c3f-41f0-88a4-1f62b363fc65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:22.623386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1ac65-2c3f-41f0-88a4-1f62b363fc65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:22.625356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1ac65-2c3f-41f0-88a4-1f62b363fc65 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-86b1ac65-2c3f-41f0-88a4-1f62b363fc65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:22.641192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:22.642670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:22.643563 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:22.643563 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:22.643563 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:22.644176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 290/590] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:22.645875 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fe141-84c3-40c7-b4b7-9ab4f01c44f6 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:22.646688 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fe141-84c3-40c7-b4b7-9ab4f01c44f6 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:22.647157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fe141-84c3-40c7-b4b7-9ab4f01c44f6 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:22.649315 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 301/591] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:22.649910 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1ac65-2c3f-41f0-88a4-1f62b363fc65 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:22.656347 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb436-460a-46c9-9cc6-a72b8332571b None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:22.656742 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb436-460a-46c9-9cc6-a72b8332571b None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:22.657118 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb436-460a-46c9-9cc6-a72b8332571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:22.680716 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-7d8cb436-460a-46c9-9cc6-a72b8332571b None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:22.682835 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-7d8cb436-460a-46c9-9cc6-a72b8332571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:22.716416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:22.785373 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 302/592] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:22.785674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1ac65-2c3f-41f0-88a4-1f62b363fc65 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:22.786549 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cb436-460a-46c9-9cc6-a72b8332571b None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:22.831668 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13913cb3-4551-4f53-8e38-6a8e3d4b7710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:22.832272 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913cb3-4551-4f53-8e38-6a8e3d4b7710 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:22.832541 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913cb3-4551-4f53-8e38-6a8e3d4b7710 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:22.832803 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913cb3-4551-4f53-8e38-6a8e3d4b7710 None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:22.833435 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13913cb3-4551-4f53-8e38-6a8e3d4b7710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:22.833729 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13913cb3-4551-4f53-8e38-6a8e3d4b7710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:22.835651 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13913cb3-4551-4f53-8e38-6a8e3d4b7710 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:22.855621 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 291/593] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:22.857294 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13913cb3-4551-4f53-8e38-6a8e3d4b7710 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:22.900754 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:22.905001 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cb436-460a-46c9-9cc6-a72b8332571b None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:22.942630 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6091a19-9aa8-4d10-9656-6d2973dcb04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:22.943256 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6091a19-9aa8-4d10-9656-6d2973dcb04f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:22.943527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6091a19-9aa8-4d10-9656-6d2973dcb04f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:22.943790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6091a19-9aa8-4d10-9656-6d2973dcb04f None admin] PATH_INFO: `/v3/roles/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:22.954986 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6091a19-9aa8-4d10-9656-6d2973dcb04f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-a6091a19-9aa8-4d10-9656-6d2973dcb04f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:22.959762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:22.960690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:22.961535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:22.965695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 303/594] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:22.966837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77dcf1-8476-41c4-8e4b-138c0eea164f None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:22.967102 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77dcf1-8476-41c4-8e4b-138c0eea164f None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:22.967360 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77dcf1-8476-41c4-8e4b-138c0eea164f None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:22.968743 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 304/595] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:22.969255 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77dcf1-8476-41c4-8e4b-138c0eea164f None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:22.978423 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13913cb3-4551-4f53-8e38-6a8e3d4b7710 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:22.989329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:23.016593 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e73976-cf47-4fd8-872c-c82fafe3079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:23.017542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e73976-cf47-4fd8-872c-c82fafe3079c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.017542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e73976-cf47-4fd8-872c-c82fafe3079c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.017755 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e73976-cf47-4fd8-872c-c82fafe3079c None admin] PATH_INFO: `/v3/users/nova` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.026489 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e73976-cf47-4fd8-872c-c82fafe3079c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:23.027953 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e73976-cf47-4fd8-872c-c82fafe3079c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-e0e73976-cf47-4fd8-872c-c82fafe3079c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:23.039589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:23.040539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 292/596] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 19:24:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:23.042547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafb3f-f0c5-4174-9821-d571cb5c94c7 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.043231 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafb3f-f0c5-4174-9821-d571cb5c94c7 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.043231 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafb3f-f0c5-4174-9821-d571cb5c94c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.063430 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-d1dafb3f-f0c5-4174-9821-d571cb5c94c7 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:23.064660 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-d1dafb3f-f0c5-4174-9821-d571cb5c94c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:23.096855 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77dcf1-8476-41c4-8e4b-138c0eea164f None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:23.136090 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795dbce-9a4d-4757-8bb2-6ec2164c1a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:23.136711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795dbce-9a4d-4757-8bb2-6ec2164c1a4c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.136984 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795dbce-9a4d-4757-8bb2-6ec2164c1a4c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.137255 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795dbce-9a4d-4757-8bb2-6ec2164c1a4c None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.138020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795dbce-9a4d-4757-8bb2-6ec2164c1a4c None admin] RBAC: Adding query filter params (name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:23.138345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795dbce-9a4d-4757-8bb2-6ec2164c1a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:23.139727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795dbce-9a4d-4757-8bb2-6ec2164c1a4c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:23.142233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 293/597] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:23.143071 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dafb3f-f0c5-4174-9821-d571cb5c94c7 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:23.147840 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 305/598] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:23.148634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795dbce-9a4d-4757-8bb2-6ec2164c1a4c None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:23.180517 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:23.242729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:23.262944 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dafb3f-f0c5-4174-9821-d571cb5c94c7 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:23.263485 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795dbce-9a4d-4757-8bb2-6ec2164c1a4c None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:23.297328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb07b2-c1e6-4c34-ab44-1f2bdc383fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:23.297937 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb07b2-c1e6-4c34-ab44-1f2bdc383fc0 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.298242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb07b2-c1e6-4c34-ab44-1f2bdc383fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.298515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb07b2-c1e6-4c34-ab44-1f2bdc383fc0 None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.299141 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972824a-fa8d-46b7-bddb-26e0ccc5fa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:23.299253 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb07b2-c1e6-4c34-ab44-1f2bdc383fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:23.299523 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb07b2-c1e6-4c34-ab44-1f2bdc383fc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:23.299775 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972824a-fa8d-46b7-bddb-26e0ccc5fa6c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.300054 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972824a-fa8d-46b7-bddb-26e0ccc5fa6c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.300325 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972824a-fa8d-46b7-bddb-26e0ccc5fa6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.300979 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb07b2-c1e6-4c34-ab44-1f2bdc383fc0 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:23.311313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972824a-fa8d-46b7-bddb-26e0ccc5fa6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-5972824a-fa8d-46b7-bddb-26e0ccc5fa6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:23.317319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:23.318269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:23.319125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 306/599] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:23.322799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972824a-fa8d-46b7-bddb-26e0ccc5fa6c None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:23.323718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 294/600] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 19:24:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:23.324724 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb07b2-c1e6-4c34-ab44-1f2bdc383fc0 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:23.416392 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:23.432646 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972824a-fa8d-46b7-bddb-26e0ccc5fa6c None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:23.434048 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb07b2-c1e6-4c34-ab44-1f2bdc383fc0 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:23.469414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aaa1e-6338-4213-b3f6-df73d922ac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:23.469881 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a104d5-5338-455d-b012-8e11cb75485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:23.470525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a104d5-5338-455d-b012-8e11cb75485a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.470799 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a104d5-5338-455d-b012-8e11cb75485a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.471070 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a104d5-5338-455d-b012-8e11cb75485a None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.471306 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aaa1e-6338-4213-b3f6-df73d922ac74 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.471722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a104d5-5338-455d-b012-8e11cb75485a None admin] RBAC: Adding query filter params (name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:23.471988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aaa1e-6338-4213-b3f6-df73d922ac74 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.472114 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a104d5-5338-455d-b012-8e11cb75485a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:23.472575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aaa1e-6338-4213-b3f6-df73d922ac74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.473556 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a104d5-5338-455d-b012-8e11cb75485a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:23.482119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:23.482275 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 295/601] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:23.483181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a104d5-5338-455d-b012-8e11cb75485a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:23.485794 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aaa1e-6338-4213-b3f6-df73d922ac74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:23.488517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aaa1e-6338-4213-b3f6-df73d922ac74 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-ad4aaa1e-6338-4213-b3f6-df73d922ac74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:23.502947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:23.504034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:23.504929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:23.504929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:23.504929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:23.504929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 307/602] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:23.504929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aaa1e-6338-4213-b3f6-df73d922ac74 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:23.584988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a104d5-5338-455d-b012-8e11cb75485a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:23.607265 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aaa1e-6338-4213-b3f6-df73d922ac74 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:23.618580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e679d4d-ec04-49c8-b7b8-ac1f10389ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:23.619186 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679d4d-ec04-49c8-b7b8-ac1f10389ad4 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.619459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679d4d-ec04-49c8-b7b8-ac1f10389ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.619739 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679d4d-ec04-49c8-b7b8-ac1f10389ad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.635034 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:23.641723 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19564d0b-f92f-438f-9547-683a688a065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:23.642381 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19564d0b-f92f-438f-9547-683a688a065c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.642655 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19564d0b-f92f-438f-9547-683a688a065c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.642924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19564d0b-f92f-438f-9547-683a688a065c None admin] PATH_INFO: `/v3/roles/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.654187 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19564d0b-f92f-438f-9547-683a688a065c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-19564d0b-f92f-438f-9547-683a688a065c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:23.659366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:23.660477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 308/603] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:23.661522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19564d0b-f92f-438f-9547-683a688a065c None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:23.693124 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e679d4d-ec04-49c8-b7b8-ac1f10389ad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:23.694619 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e679d4d-ec04-49c8-b7b8-ac1f10389ad4 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:23.715124 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:23.766405 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19564d0b-f92f-438f-9547-683a688a065c None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:23.795095 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 296/604] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:24:23.795938 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e679d4d-ec04-49c8-b7b8-ac1f10389ad4 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:23.806684 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc41a60-92d2-434e-ad8d-fdae6a98594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:23.807327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc41a60-92d2-434e-ad8d-fdae6a98594d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.807733 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc41a60-92d2-434e-ad8d-fdae6a98594d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.808008 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc41a60-92d2-434e-ad8d-fdae6a98594d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.818976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc41a60-92d2-434e-ad8d-fdae6a98594d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:23.820630 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc41a60-92d2-434e-ad8d-fdae6a98594d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-ddc41a60-92d2-434e-ad8d-fdae6a98594d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:23.834580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:23.835729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:23.836814 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:23.836814 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:23.836814 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:23.836814 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 309/605] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:23.837621 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc41a60-92d2-434e-ad8d-fdae6a98594d None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:23.844568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:23.898194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e679d4d-ec04-49c8-b7b8-ac1f10389ad4 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:23.934066 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7570a-5838-4814-97a4-61cd68c7239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:23.934683 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7570a-5838-4814-97a4-61cd68c7239c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.935118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7570a-5838-4814-97a4-61cd68c7239c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.935386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7570a-5838-4814-97a4-61cd68c7239c None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.936016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7570a-5838-4814-97a4-61cd68c7239c None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:23.936306 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7570a-5838-4814-97a4-61cd68c7239c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:23.937660 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7570a-5838-4814-97a4-61cd68c7239c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:23.938520 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc41a60-92d2-434e-ad8d-fdae6a98594d None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:23.940839 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:23.948629 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 297/606] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:23.949360 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7570a-5838-4814-97a4-61cd68c7239c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:23.979344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a2316-7603-46e5-9b70-3f5814974a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:23.980036 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a2316-7603-46e5-9b70-3f5814974a76 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:23.980313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a2316-7603-46e5-9b70-3f5814974a76 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:23.980584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a2316-7603-46e5-9b70-3f5814974a76 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:23.981261 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a2316-7603-46e5-9b70-3f5814974a76 None admin] RBAC: Adding query filter params (name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:23.981577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a2316-7603-46e5-9b70-3f5814974a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:23.983251 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a2316-7603-46e5-9b70-3f5814974a76 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:23.992857 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 310/607] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:24:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:23.993652 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a2316-7603-46e5-9b70-3f5814974a76 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.053274 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7570a-5838-4814-97a4-61cd68c7239c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.060055 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:24.086064 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a32df-7e43-4a91-9fc2-fb5f3e42eda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.086694 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a32df-7e43-4a91-9fc2-fb5f3e42eda6 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.086970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a32df-7e43-4a91-9fc2-fb5f3e42eda6 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.087240 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a32df-7e43-4a91-9fc2-fb5f3e42eda6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.092179 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a2316-7603-46e5-9b70-3f5814974a76 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.097821 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a32df-7e43-4a91-9fc2-fb5f3e42eda6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.099297 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a32df-7e43-4a91-9fc2-fb5f3e42eda6 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-632a32df-7e43-4a91-9fc2-fb5f3e42eda6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:24.113251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:24.119108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:24.120172 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:24.120172 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:24.120172 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:24.120172 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 298/608] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:24.120172 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a32df-7e43-4a91-9fc2-fb5f3e42eda6 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.124918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414eaf9-5c2a-4316-b39a-fcb5e0b7bc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.125531 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414eaf9-5c2a-4316-b39a-fcb5e0b7bc99 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.125804 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414eaf9-5c2a-4316-b39a-fcb5e0b7bc99 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.126108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414eaf9-5c2a-4316-b39a-fcb5e0b7bc99 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.126738 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414eaf9-5c2a-4316-b39a-fcb5e0b7bc99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:24.127032 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414eaf9-5c2a-4316-b39a-fcb5e0b7bc99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.128390 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414eaf9-5c2a-4316-b39a-fcb5e0b7bc99 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.140361 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 311/609] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:24.141177 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414eaf9-5c2a-4316-b39a-fcb5e0b7bc99 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.169708 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:24.219080 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a32df-7e43-4a91-9fc2-fb5f3e42eda6 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.249884 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414eaf9-5c2a-4316-b39a-fcb5e0b7bc99 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.252810 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216276b2-be1e-49db-ac3d-f652c6aea2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.253433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216276b2-be1e-49db-ac3d-f652c6aea2d1 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.253707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216276b2-be1e-49db-ac3d-f652c6aea2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.253962 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216276b2-be1e-49db-ac3d-f652c6aea2d1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.261377 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216276b2-be1e-49db-ac3d-f652c6aea2d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.262882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216276b2-be1e-49db-ac3d-f652c6aea2d1 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-216276b2-be1e-49db-ac3d-f652c6aea2d1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:24.274658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:24.275772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 299/610] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:24.276933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216276b2-be1e-49db-ac3d-f652c6aea2d1 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.285925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2530a8-7815-4098-906a-f5d6277be982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.286582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2530a8-7815-4098-906a-f5d6277be982 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.286854 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2530a8-7815-4098-906a-f5d6277be982 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.287109 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2530a8-7815-4098-906a-f5d6277be982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.296255 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:24.298892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2530a8-7815-4098-906a-f5d6277be982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.300448 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2530a8-7815-4098-906a-f5d6277be982 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-cb2530a8-7815-4098-906a-f5d6277be982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:24.316242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:24.317216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:24.318627 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:24.318627 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:24.318627 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:24.318627 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 312/611] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:24.318627 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2530a8-7815-4098-906a-f5d6277be982 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.383830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216276b2-be1e-49db-ac3d-f652c6aea2d1 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.393823 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:24.417063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2530a8-7815-4098-906a-f5d6277be982 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.418183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d1098-e4d6-4694-a04c-70cb2afd1adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.418779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1098-e4d6-4694-a04c-70cb2afd1adb None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.419047 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1098-e4d6-4694-a04c-70cb2afd1adb None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.419383 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1098-e4d6-4694-a04c-70cb2afd1adb None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.420006 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d1098-e4d6-4694-a04c-70cb2afd1adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:24.420299 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d1098-e4d6-4694-a04c-70cb2afd1adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.421657 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d1098-e4d6-4694-a04c-70cb2afd1adb None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.433651 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 300/612] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:24.435303 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d1098-e4d6-4694-a04c-70cb2afd1adb None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.454578 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bce67-222d-4418-9a73-568dceb2accc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.455204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bce67-222d-4418-9a73-568dceb2accc None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.455476 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bce67-222d-4418-9a73-568dceb2accc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.455740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bce67-222d-4418-9a73-568dceb2accc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.463420 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bce67-222d-4418-9a73-568dceb2accc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.464860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bce67-222d-4418-9a73-568dceb2accc None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-7e0bce67-222d-4418-9a73-568dceb2accc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:24.480940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:24.487167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 313/613] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:24.488136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bce67-222d-4418-9a73-568dceb2accc None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.518486 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:24.542266 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d1098-e4d6-4694-a04c-70cb2afd1adb None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.578607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794220d-6b8c-4028-95ea-f617e83563bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.579207 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794220d-6b8c-4028-95ea-f617e83563bf None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.579482 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794220d-6b8c-4028-95ea-f617e83563bf None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.579771 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794220d-6b8c-4028-95ea-f617e83563bf None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.580504 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794220d-6b8c-4028-95ea-f617e83563bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:24.580805 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794220d-6b8c-4028-95ea-f617e83563bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.582296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794220d-6b8c-4028-95ea-f617e83563bf None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.589136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bce67-222d-4418-9a73-568dceb2accc None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.599417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 301/614] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:24.600221 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794220d-6b8c-4028-95ea-f617e83563bf None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.627871 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77838396-7640-451c-90da-55004033e539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.628482 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77838396-7640-451c-90da-55004033e539 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.628768 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77838396-7640-451c-90da-55004033e539 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.629033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77838396-7640-451c-90da-55004033e539 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.629681 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77838396-7640-451c-90da-55004033e539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:24.629984 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77838396-7640-451c-90da-55004033e539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.631404 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77838396-7640-451c-90da-55004033e539 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.639238 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:24.644792 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 314/615] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:24.645777 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77838396-7640-451c-90da-55004033e539 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.704274 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794220d-6b8c-4028-95ea-f617e83563bf None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.738802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc4747-f408-4aab-8b3a-9711d4f59176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.740494 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc4747-f408-4aab-8b3a-9711d4f59176 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.740798 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc4747-f408-4aab-8b3a-9711d4f59176 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.741068 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc4747-f408-4aab-8b3a-9711d4f59176 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.744129 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:24.748774 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77838396-7640-451c-90da-55004033e539 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.751035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc4747-f408-4aab-8b3a-9711d4f59176 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.752729 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc4747-f408-4aab-8b3a-9711d4f59176 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-d4fc4747-f408-4aab-8b3a-9711d4f59176 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:24.764318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:24.765268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:24.766200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:24.766200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:24.766200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:24.766200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:24.766200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:24.766200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:24.766200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:24.766200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:24.766200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 302/616] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:24.766200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc4747-f408-4aab-8b3a-9711d4f59176 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.788634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bc1f1-2240-4be3-830e-5ec291d52e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.789255 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc1f1-2240-4be3-830e-5ec291d52e2a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.789541 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc1f1-2240-4be3-830e-5ec291d52e2a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.789815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc1f1-2240-4be3-830e-5ec291d52e2a None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.790576 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bc1f1-2240-4be3-830e-5ec291d52e2a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:24.791244 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bc1f1-2240-4be3-830e-5ec291d52e2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.792703 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bc1f1-2240-4be3-830e-5ec291d52e2a None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.815117 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 315/617] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:24.815932 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bc1f1-2240-4be3-830e-5ec291d52e2a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.874139 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:24.876048 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc4747-f408-4aab-8b3a-9711d4f59176 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.916865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135f25f-b368-45b9-b909-8908002191ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.917602 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135f25f-b368-45b9-b909-8908002191ad None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.917966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135f25f-b368-45b9-b909-8908002191ad None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.918364 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135f25f-b368-45b9-b909-8908002191ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.920925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bc1f1-2240-4be3-830e-5ec291d52e2a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.957794 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d440379-610b-4f3d-ac7b-c84fca90bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.958448 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d440379-610b-4f3d-ac7b-c84fca90bd5f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.958741 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d440379-610b-4f3d-ac7b-c84fca90bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.958995 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d440379-610b-4f3d-ac7b-c84fca90bd5f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.966946 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d440379-610b-4f3d-ac7b-c84fca90bd5f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.968541 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d440379-610b-4f3d-ac7b-c84fca90bd5f None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-1d440379-610b-4f3d-ac7b-c84fca90bd5f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:24.980560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:24.981499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:24.983060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:24.983060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:24.983060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:24.983060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:24.983060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:24.983060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:24.983060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:24.983060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:24.983060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:24:24.983060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:24.983667 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:24.983740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 316/618] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:24.983740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d440379-610b-4f3d-ac7b-c84fca90bd5f None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.992854 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135f25f-b368-45b9-b909-8908002191ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.994273 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135f25f-b368-45b9-b909-8908002191ad None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:25.084123 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d440379-610b-4f3d-ac7b-c84fca90bd5f None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:25.099183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 303/619] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:24:25.099915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:25.100125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135f25f-b368-45b9-b909-8908002191ad None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:25.123182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd492d-d512-4773-bcd5-82b70dee43c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:25.123806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd492d-d512-4773-bcd5-82b70dee43c5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:25.124187 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd492d-d512-4773-bcd5-82b70dee43c5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:25.124548 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd492d-d512-4773-bcd5-82b70dee43c5 None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:25.125218 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd492d-d512-4773-bcd5-82b70dee43c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:25.125549 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd492d-d512-4773-bcd5-82b70dee43c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:25.127002 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd492d-d512-4773-bcd5-82b70dee43c5 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:25.139251 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 317/620] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:25.140039 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd492d-d512-4773-bcd5-82b70dee43c5 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:25.193301 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:25.200708 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135f25f-b368-45b9-b909-8908002191ad None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:25.241791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b8cf2-5730-4603-9b39-64d0a789fb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:25.242672 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8cf2-5730-4603-9b39-64d0a789fb31 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:25.243131 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8cf2-5730-4603-9b39-64d0a789fb31 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:25.243358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8cf2-5730-4603-9b39-64d0a789fb31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:25.261259 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd492d-d512-4773-bcd5-82b70dee43c5 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:25.297070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14a651-0122-4d56-9f05-a8801767df90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:25.297672 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14a651-0122-4d56-9f05-a8801767df90 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:25.297932 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14a651-0122-4d56-9f05-a8801767df90 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:25.298240 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14a651-0122-4d56-9f05-a8801767df90 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:25.298952 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14a651-0122-4d56-9f05-a8801767df90 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:25.299258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14a651-0122-4d56-9f05-a8801767df90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:25.300717 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14a651-0122-4d56-9f05-a8801767df90 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:25.318621 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 318/621] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Aug 19 19:24:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:25.319630 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14a651-0122-4d56-9f05-a8801767df90 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:25.321095 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b8cf2-5730-4603-9b39-64d0a789fb31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:25.322591 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b8cf2-5730-4603-9b39-64d0a789fb31 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:25.354675 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:25.413595 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:25.420125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14a651-0122-4d56-9f05-a8801767df90 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:25.421522 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 304/622] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:24:25.422390 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b8cf2-5730-4603-9b39-64d0a789fb31 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:25.455063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee8c89-747a-401f-9bc1-89f6c86faf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:25.455688 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee8c89-747a-401f-9bc1-89f6c86faf8e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:25.455957 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee8c89-747a-401f-9bc1-89f6c86faf8e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:25.456230 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee8c89-747a-401f-9bc1-89f6c86faf8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:25.466173 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee8c89-747a-401f-9bc1-89f6c86faf8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:25.467824 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee8c89-747a-401f-9bc1-89f6c86faf8e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-9eee8c89-747a-401f-9bc1-89f6c86faf8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:25.482223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:25.483270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:25.484145 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:25.484145 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:25.484145 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:25.484145 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 319/623] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:25.484145 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee8c89-747a-401f-9bc1-89f6c86faf8e None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:25.522610 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b8cf2-5730-4603-9b39-64d0a789fb31 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:25.557948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3954a6-242b-4cef-aa42-bf418780dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:25.558584 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3954a6-242b-4cef-aa42-bf418780dda4 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:25.558853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3954a6-242b-4cef-aa42-bf418780dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:25.559112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3954a6-242b-4cef-aa42-bf418780dda4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:25.559976 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3954a6-242b-4cef-aa42-bf418780dda4 None admin] RBAC: Adding query filter params (role.id=db8abf37adff4704889523e773b95924, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=ff0c7740e6814c6c9515d0aed78bba68) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:25.560272 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3954a6-242b-4cef-aa42-bf418780dda4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:25.561685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3954a6-242b-4cef-aa42-bf418780dda4 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:25.567571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 305/624] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:24:25 2022] GET /identity/v3/role_assignments?user.id=ff0c7740e6814c6c9515d0aed78bba68&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=db8abf37adff4704889523e773b95924 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:25.568355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3954a6-242b-4cef-aa42-bf418780dda4 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:25.575140 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:25.593606 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee8c89-747a-401f-9bc1-89f6c86faf8e None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:25.632862 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:25.636771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0956a76-c31a-4d96-8362-d9f2694d30bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:25.637401 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0956a76-c31a-4d96-8362-d9f2694d30bc None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:25.637679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0956a76-c31a-4d96-8362-d9f2694d30bc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:25.638066 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0956a76-c31a-4d96-8362-d9f2694d30bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:25.679227 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3954a6-242b-4cef-aa42-bf418780dda4 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:25.717689 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0956a76-c31a-4d96-8362-d9f2694d30bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:25.718753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a60bf6-82b4-4e63-a48a-08f8bc09041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:25.719403 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60bf6-82b4-4e63-a48a-08f8bc09041a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:25.719705 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60bf6-82b4-4e63-a48a-08f8bc09041a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:25.719977 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60bf6-82b4-4e63-a48a-08f8bc09041a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:25.720857 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0956a76-c31a-4d96-8362-d9f2694d30bc None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:25.734788 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a60bf6-82b4-4e63-a48a-08f8bc09041a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:25.736654 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a60bf6-82b4-4e63-a48a-08f8bc09041a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-80a60bf6-82b4-4e63-a48a-08f8bc09041a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:25.753117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:25.754258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:25.760580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:25.760580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:25.760580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:25.760580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 306/625] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:25.760580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a60bf6-82b4-4e63-a48a-08f8bc09041a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:25.831621 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:25.849135 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 320/626] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:24:25.849890 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0956a76-c31a-4d96-8362-d9f2694d30bc None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:25.873635 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a60bf6-82b4-4e63-a48a-08f8bc09041a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:25.888321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:25.911280 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099028fb-656f-4dc5-8c8e-34d11502e4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:25.912031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099028fb-656f-4dc5-8c8e-34d11502e4a1 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:25.912306 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099028fb-656f-4dc5-8c8e-34d11502e4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:25.912675 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099028fb-656f-4dc5-8c8e-34d11502e4a1 None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:25.913374 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099028fb-656f-4dc5-8c8e-34d11502e4a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:25.913679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099028fb-656f-4dc5-8c8e-34d11502e4a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:25.915137 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099028fb-656f-4dc5-8c8e-34d11502e4a1 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:25.932391 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 307/627] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:25.932391 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099028fb-656f-4dc5-8c8e-34d11502e4a1 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:25.956178 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0956a76-c31a-4d96-8362-d9f2694d30bc None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:25.995532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d630673-74dc-44f6-ba65-be8cc7dc08d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:25.996235 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d630673-74dc-44f6-ba65-be8cc7dc08d9 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:25.996580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d630673-74dc-44f6-ba65-be8cc7dc08d9 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:25.996922 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d630673-74dc-44f6-ba65-be8cc7dc08d9 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:25.997669 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d630673-74dc-44f6-ba65-be8cc7dc08d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:25.998050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d630673-74dc-44f6-ba65-be8cc7dc08d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:25.999527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d630673-74dc-44f6-ba65-be8cc7dc08d9 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:26.015674 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 321/628] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:26.015674 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d630673-74dc-44f6-ba65-be8cc7dc08d9 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:26.044194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099028fb-656f-4dc5-8c8e-34d11502e4a1 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:26.063881 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:26.081264 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838cf97-5839-427a-898b-b24ed114a4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:26.082074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838cf97-5839-427a-898b-b24ed114a4fe None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:26.082356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838cf97-5839-427a-898b-b24ed114a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:26.082719 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838cf97-5839-427a-898b-b24ed114a4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:26.094555 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838cf97-5839-427a-898b-b24ed114a4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:26.096105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838cf97-5839-427a-898b-b24ed114a4fe None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-5838cf97-5839-427a-898b-b24ed114a4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:26.112783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:26.114012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:26.115056 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:26.115056 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:26.115056 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:26.115056 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 308/629] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:26.115670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838cf97-5839-427a-898b-b24ed114a4fe None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:26.131858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d630673-74dc-44f6-ba65-be8cc7dc08d9 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:26.143929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:26.168762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54b753-b4e9-4c96-83e7-03212e521c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:26.169593 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54b753-b4e9-4c96-83e7-03212e521c60 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:26.169864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54b753-b4e9-4c96-83e7-03212e521c60 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:26.170161 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54b753-b4e9-4c96-83e7-03212e521c60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:26.177158 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54b753-b4e9-4c96-83e7-03212e521c60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:26.178671 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54b753-b4e9-4c96-83e7-03212e521c60 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-9b54b753-b4e9-4c96-83e7-03212e521c60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:26.190170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:26.191260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:26.192176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:26.192176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:26.192176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:26.192176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:26.192176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:26.192176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:26.192176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:26.192176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:26.192176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 322/630] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:26.192675 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54b753-b4e9-4c96-83e7-03212e521c60 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:26.244319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838cf97-5839-427a-898b-b24ed114a4fe None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:26.280577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e3427-2ddd-40d6-9db1-19a55d07c67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:26.281201 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3427-2ddd-40d6-9db1-19a55d07c67c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:26.281474 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3427-2ddd-40d6-9db1-19a55d07c67c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:26.282239 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3427-2ddd-40d6-9db1-19a55d07c67c None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:26.291183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e3427-2ddd-40d6-9db1-19a55d07c67c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:26.292625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e3427-2ddd-40d6-9db1-19a55d07c67c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-021e3427-2ddd-40d6-9db1-19a55d07c67c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:26.304515 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:26.305448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:26.306433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:26.306433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:26.306433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:26.306433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:26.306433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:26.306433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:26.306433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:26.306433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:26.306433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 309/631] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:26.306927 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e3427-2ddd-40d6-9db1-19a55d07c67c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:26.313914 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54b753-b4e9-4c96-83e7-03212e521c60 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:26.322713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:26.353726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58fdc8-74cc-42f2-aef8-7e79588038b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:26.354282 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58fdc8-74cc-42f2-aef8-7e79588038b3 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:26.354559 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58fdc8-74cc-42f2-aef8-7e79588038b3 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:26.354826 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58fdc8-74cc-42f2-aef8-7e79588038b3 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:26.355462 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58fdc8-74cc-42f2-aef8-7e79588038b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:26.355757 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58fdc8-74cc-42f2-aef8-7e79588038b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:26.357750 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58fdc8-74cc-42f2-aef8-7e79588038b3 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:26.369506 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 323/632] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:26.375160 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58fdc8-74cc-42f2-aef8-7e79588038b3 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:26.395625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:26.414897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e3427-2ddd-40d6-9db1-19a55d07c67c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:26.450381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27497663-ef87-4a2d-9ed4-45ee1eb5e0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:26.451433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497663-ef87-4a2d-9ed4-45ee1eb5e0c0 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:26.451711 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497663-ef87-4a2d-9ed4-45ee1eb5e0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:26.451980 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497663-ef87-4a2d-9ed4-45ee1eb5e0c0 None admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:26.452673 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27497663-ef87-4a2d-9ed4-45ee1eb5e0c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:26.452976 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27497663-ef87-4a2d-9ed4-45ee1eb5e0c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:26.454439 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27497663-ef87-4a2d-9ed4-45ee1eb5e0c0 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:26.472455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 310/633] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:26.473393 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27497663-ef87-4a2d-9ed4-45ee1eb5e0c0 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:26.484792 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58fdc8-74cc-42f2-aef8-7e79588038b3 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:26.522826 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721fcd-99ae-41c8-966e-0adda602475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:26.523573 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721fcd-99ae-41c8-966e-0adda602475a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:26.523853 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721fcd-99ae-41c8-966e-0adda602475a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:26.524225 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721fcd-99ae-41c8-966e-0adda602475a None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:26.524913 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d721fcd-99ae-41c8-966e-0adda602475a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:26.525216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d721fcd-99ae-41c8-966e-0adda602475a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:26.526691 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d721fcd-99ae-41c8-966e-0adda602475a None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:26.549344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 324/634] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:26.549344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721fcd-99ae-41c8-966e-0adda602475a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:26.575694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:26.587224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27497663-ef87-4a2d-9ed4-45ee1eb5e0c0 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:26.626520 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cff695-d57b-4c2b-87fd-0f26f9382cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:26.627077 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cff695-d57b-4c2b-87fd-0f26f9382cd8 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:26.627352 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cff695-d57b-4c2b-87fd-0f26f9382cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:26.627620 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cff695-d57b-4c2b-87fd-0f26f9382cd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:26.635161 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cff695-d57b-4c2b-87fd-0f26f9382cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:26.636618 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cff695-d57b-4c2b-87fd-0f26f9382cd8 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-44cff695-d57b-4c2b-87fd-0f26f9382cd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:26.648369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:26.649296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:26.650686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:26.650686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:26.650686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:26.650686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:26.650686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:26.650686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:26.650686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:26.650686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:26.650686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 311/635] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:26.650686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cff695-d57b-4c2b-87fd-0f26f9382cd8 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:26.655331 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:26.660978 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721fcd-99ae-41c8-966e-0adda602475a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:26.699362 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df73af-d4a8-414d-b765-af6ebd5c3022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:26.700229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df73af-d4a8-414d-b765-af6ebd5c3022 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:26.700559 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df73af-d4a8-414d-b765-af6ebd5c3022 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:26.700771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df73af-d4a8-414d-b765-af6ebd5c3022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:26.701481 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df73af-d4a8-414d-b765-af6ebd5c3022 None admin] RBAC: Adding query filter params (role.id=db8abf37adff4704889523e773b95924, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=5f36f349d532411ba09da3231aef3f1b) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:26.701796 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df73af-d4a8-414d-b765-af6ebd5c3022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:26.703261 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df73af-d4a8-414d-b765-af6ebd5c3022 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:26.709310 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 325/636] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:24:26 2022] GET /identity/v3/role_assignments?user.id=5f36f349d532411ba09da3231aef3f1b&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=db8abf37adff4704889523e773b95924 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:26.709910 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df73af-d4a8-414d-b765-af6ebd5c3022 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:26.766506 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cff695-d57b-4c2b-87fd-0f26f9382cd8 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:26.804881 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d72967-fbd2-46e1-8966-36c04aab5d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:26.806353 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d72967-fbd2-46e1-8966-36c04aab5d0c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:26.806353 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d72967-fbd2-46e1-8966-36c04aab5d0c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:26.806353 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d72967-fbd2-46e1-8966-36c04aab5d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:26.807210 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d72967-fbd2-46e1-8966-36c04aab5d0c None admin] RBAC: Adding query filter params (role.id=db8abf37adff4704889523e773b95924, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=d19d16bc47614980b4f6d57e39a0f4b3) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:26.807615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d72967-fbd2-46e1-8966-36c04aab5d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:26.809204 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d72967-fbd2-46e1-8966-36c04aab5d0c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:26.822482 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 312/637] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:24:26 2022] GET /identity/v3/role_assignments?user.id=d19d16bc47614980b4f6d57e39a0f4b3&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=db8abf37adff4704889523e773b95924 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:26.832819 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:26.847595 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df73af-d4a8-414d-b765-af6ebd5c3022 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:26.892903 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de656a28-b747-4d18-8e11-fa62a970f316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:26.893802 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656a28-b747-4d18-8e11-fa62a970f316 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:26.894324 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656a28-b747-4d18-8e11-fa62a970f316 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:26.894740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656a28-b747-4d18-8e11-fa62a970f316 None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:26.895625 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de656a28-b747-4d18-8e11-fa62a970f316 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:26.896161 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de656a28-b747-4d18-8e11-fa62a970f316 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:26.897818 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de656a28-b747-4d18-8e11-fa62a970f316 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:26.912912 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 326/638] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:26.919131 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d72967-fbd2-46e1-8966-36c04aab5d0c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:27.001577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:27.038572 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d72967-fbd2-46e1-8966-36c04aab5d0c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:27.079606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b30e6-f65b-4137-a236-486675cc8d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:27.080224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b30e6-f65b-4137-a236-486675cc8d9d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:27.080505 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b30e6-f65b-4137-a236-486675cc8d9d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:27.080831 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b30e6-f65b-4137-a236-486675cc8d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:27.081578 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b30e6-f65b-4137-a236-486675cc8d9d None admin] RBAC: Adding query filter params (role.id=db8abf37adff4704889523e773b95924, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=3ba4a0ad60a549bd8255124ffcd83f30) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:27.081882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b30e6-f65b-4137-a236-486675cc8d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:27.083458 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b30e6-f65b-4137-a236-486675cc8d9d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:27.090378 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 313/639] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:24:26 2022] GET /identity/v3/role_assignments?user.id=3ba4a0ad60a549bd8255124ffcd83f30&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=db8abf37adff4704889523e773b95924 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:27.862708 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d1b2-bce4-4ca6-ae45-23bfab635e5c None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:27.863279 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d1b2-bce4-4ca6-ae45-23bfab635e5c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:27.863279 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d1b2-bce4-4ca6-ae45-23bfab635e5c None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:27.864861 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 327/640] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:27.870195 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08211e3e-eda9-46b0-9b30-8c2ee9b6170d None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:27.870622 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08211e3e-eda9-46b0-9b30-8c2ee9b6170d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:27.870766 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08211e3e-eda9-46b0-9b30-8c2ee9b6170d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:27.889942 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-08211e3e-eda9-46b0-9b30-8c2ee9b6170d None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:27.891189 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-08211e3e-eda9-46b0-9b30-8c2ee9b6170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:27.962593 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 314/641] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:28.296574 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d1b2-bce4-4ca6-ae45-23bfab635e5c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:28.404383 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d1b2-bce4-4ca6-ae45-23bfab635e5c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:28.441076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d853e-2f02-4413-95fd-e13f55e5ce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:28.441715 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d853e-2f02-4413-95fd-e13f55e5ce33 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:28.442024 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d853e-2f02-4413-95fd-e13f55e5ce33 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:28.442286 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d853e-2f02-4413-95fd-e13f55e5ce33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:28.453285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d853e-2f02-4413-95fd-e13f55e5ce33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-490d853e-2f02-4413-95fd-e13f55e5ce33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:28.457969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:28.458987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:28.460176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 328/642] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:24:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:28.465109 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08211e3e-eda9-46b0-9b30-8c2ee9b6170d None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:28.526563 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:28.566393 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08211e3e-eda9-46b0-9b30-8c2ee9b6170d None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:28.604107 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae89e8-744f-4064-8a81-581d32f6e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:28.604722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae89e8-744f-4064-8a81-581d32f6e09b None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:28.604997 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae89e8-744f-4064-8a81-581d32f6e09b None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:28.605267 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae89e8-744f-4064-8a81-581d32f6e09b None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:28.605946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae89e8-744f-4064-8a81-581d32f6e09b None admin] RBAC: Adding query filter params (name=admin) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:28.606273 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae89e8-744f-4064-8a81-581d32f6e09b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:28.607713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae89e8-744f-4064-8a81-581d32f6e09b None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:28.616958 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 315/643] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:28.622614 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d853e-2f02-4413-95fd-e13f55e5ce33 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:28.636677 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:28.732172 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d853e-2f02-4413-95fd-e13f55e5ce33 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:28.767504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a87d8d-d2db-4033-90f3-60db5a240fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:28.768139 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a87d8d-d2db-4033-90f3-60db5a240fe5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:28.768416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a87d8d-d2db-4033-90f3-60db5a240fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:28.768687 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a87d8d-d2db-4033-90f3-60db5a240fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:28.779556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a87d8d-d2db-4033-90f3-60db5a240fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:28.781025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a87d8d-d2db-4033-90f3-60db5a240fe5 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-e3a87d8d-d2db-4033-90f3-60db5a240fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:28.797327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:28.798758 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:28.800395 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:28.800395 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:28.800395 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:28.800395 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 329/644] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:28.808116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae89e8-744f-4064-8a81-581d32f6e09b None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:28.925837 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae89e8-744f-4064-8a81-581d32f6e09b None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:28.953468 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:28.964236 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96207399-7f96-442e-a675-f8c8221ed496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:28.964843 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207399-7f96-442e-a675-f8c8221ed496 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:28.965551 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207399-7f96-442e-a675-f8c8221ed496 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:28.966149 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207399-7f96-442e-a675-f8c8221ed496 None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:28.967118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96207399-7f96-442e-a675-f8c8221ed496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:28.967925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96207399-7f96-442e-a675-f8c8221ed496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:28.969304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96207399-7f96-442e-a675-f8c8221ed496 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:28.981865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 316/645] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:28.987311 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a87d8d-d2db-4033-90f3-60db5a240fe5 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:29.053091 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:29.100400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead06d1-76f5-4bfb-a2e3-abddd30b408d None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.101048 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead06d1-76f5-4bfb-a2e3-abddd30b408d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.101343 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a87d8d-d2db-4033-90f3-60db5a240fe5 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:29.101782 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead06d1-76f5-4bfb-a2e3-abddd30b408d None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.106978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 317/646] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:29.109894 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4d95-a948-4e5b-8f1f-fb934e283445 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.110429 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4d95-a948-4e5b-8f1f-fb934e283445 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.111001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4d95-a948-4e5b-8f1f-fb934e283445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.130937 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-22bd4d95-a948-4e5b-8f1f-fb934e283445 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:29.133437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-22bd4d95-a948-4e5b-8f1f-fb934e283445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:29.141190 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eb91a-9847-449c-9d91-1cfc44fa238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:29.141838 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eb91a-9847-449c-9d91-1cfc44fa238b None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.142161 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eb91a-9847-449c-9d91-1cfc44fa238b None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.142434 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eb91a-9847-449c-9d91-1cfc44fa238b None admin] PATH_INFO: `/v3/users/nova` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.155255 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896eb91a-9847-449c-9d91-1cfc44fa238b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:29.157078 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896eb91a-9847-449c-9d91-1cfc44fa238b None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-896eb91a-9847-449c-9d91-1cfc44fa238b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:29.174084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:29.175116 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:29.176656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:29.176656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:29.176656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:29.176656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:29.176656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:29.176656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:29.176656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:29.176656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:29.176656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:29.176656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:29.176656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 330/647] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 19:24:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:29.181503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eb91a-9847-449c-9d91-1cfc44fa238b None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:29.239163 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 318/648] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:29.251180 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e20c-0869-4145-870b-b85a0acb328f None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.251463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e20c-0869-4145-870b-b85a0acb328f None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.251726 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e20c-0869-4145-870b-b85a0acb328f None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.253285 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 319/649] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:24:29.258097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418e8cc-baf7-4571-82a0-6919dbab201a None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.258381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418e8cc-baf7-4571-82a0-6919dbab201a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.258649 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418e8cc-baf7-4571-82a0-6919dbab201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.277541 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-4418e8cc-baf7-4571-82a0-6919dbab201a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:29.278869 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-4418e8cc-baf7-4571-82a0-6919dbab201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:29.307776 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eb91a-9847-449c-9d91-1cfc44fa238b None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:29.331327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:29.344102 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf705a3-20d2-4068-b0e3-c33aa405bbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:29.344708 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf705a3-20d2-4068-b0e3-c33aa405bbf6 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.344994 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf705a3-20d2-4068-b0e3-c33aa405bbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.345255 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf705a3-20d2-4068-b0e3-c33aa405bbf6 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.346160 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf705a3-20d2-4068-b0e3-c33aa405bbf6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:29.346581 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf705a3-20d2-4068-b0e3-c33aa405bbf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:29.347752 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf705a3-20d2-4068-b0e3-c33aa405bbf6 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:29.366044 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 331/650] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 19:24:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:29.366210 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 320/651] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:24:29.370970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418e8cc-baf7-4571-82a0-6919dbab201a None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:29.371276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9837-93e7-4601-99b4-d2a0e9bc6472 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.371558 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9837-93e7-4601-99b4-d2a0e9bc6472 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.371825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9837-93e7-4601-99b4-d2a0e9bc6472 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.374125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 332/652] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:29.387563 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43a251-0046-44f0-8d3e-ab87f865268b None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.387892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43a251-0046-44f0-8d3e-ab87f865268b None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.388140 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43a251-0046-44f0-8d3e-ab87f865268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.409648 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-6d43a251-0046-44f0-8d3e-ab87f865268b None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:29.411426 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-6d43a251-0046-44f0-8d3e-ab87f865268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:29.429488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:29.486835 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418e8cc-baf7-4571-82a0-6919dbab201a None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:29.506234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 333/653] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:29.527828 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef59e26-abb8-4e55-8587-3f1bb9de922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:29.528518 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef59e26-abb8-4e55-8587-3f1bb9de922e None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.528806 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef59e26-abb8-4e55-8587-3f1bb9de922e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.529159 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef59e26-abb8-4e55-8587-3f1bb9de922e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.563722 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43a251-0046-44f0-8d3e-ab87f865268b None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:29.608128 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef59e26-abb8-4e55-8587-3f1bb9de922e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:29.609657 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef59e26-abb8-4e55-8587-3f1bb9de922e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:29.667397 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:29.687865 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43a251-0046-44f0-8d3e-ab87f865268b None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:29.701654 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:29.725861 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc5515-68db-4c98-9055-37eb0790d9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:29.726727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5515-68db-4c98-9055-37eb0790d9de None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.727264 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5515-68db-4c98-9055-37eb0790d9de None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.727368 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 321/654] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:24:29.727994 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef59e26-abb8-4e55-8587-3f1bb9de922e None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:29.731872 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5515-68db-4c98-9055-37eb0790d9de None admin] PATH_INFO: `/v3/services/image` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.732697 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc5515-68db-4c98-9055-37eb0790d9de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:29.734132 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc5515-68db-4c98-9055-37eb0790d9de None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-03bc5515-68db-4c98-9055-37eb0790d9de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:29.745444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:29.746509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:29.747424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 334/655] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Aug 19 19:24:29 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:29.748208 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc5515-68db-4c98-9055-37eb0790d9de None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:29.852865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef59e26-abb8-4e55-8587-3f1bb9de922e None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:29.868031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc5515-68db-4c98-9055-37eb0790d9de None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:29.891141 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32260353-0788-4c87-9843-c22c7c2c6db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:29.891760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260353-0788-4c87-9843-c22c7c2c6db2 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.892026 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260353-0788-4c87-9843-c22c7c2c6db2 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.892291 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260353-0788-4c87-9843-c22c7c2c6db2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.892867 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32260353-0788-4c87-9843-c22c7c2c6db2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:29.894381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32260353-0788-4c87-9843-c22c7c2c6db2 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-32260353-0788-4c87-9843-c22c7c2c6db2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:29.905542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:29.906614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:24:29.907462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:29.908220 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3520e6-a433-4dd6-b162-99541ccc9542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:29.908309 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 322/656] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Aug 19 19:24:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:29.908389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3520e6-a433-4dd6-b162-99541ccc9542 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:29.908459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32260353-0788-4c87-9843-c22c7c2c6db2 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:29.908535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3520e6-a433-4dd6-b162-99541ccc9542 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:29.908535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3520e6-a433-4dd6-b162-99541ccc9542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:29.923537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:29.930745 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3520e6-a433-4dd6-b162-99541ccc9542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:29.930745 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3520e6-a433-4dd6-b162-99541ccc9542 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-4c3520e6-a433-4dd6-b162-99541ccc9542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:29.945882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:29.947572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:29.948550 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:29.948550 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:29.948550 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:29.948550 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 335/657] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:29.948550 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3520e6-a433-4dd6-b162-99541ccc9542 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:29.982446 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:30.023697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32260353-0788-4c87-9843-c22c7c2c6db2 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:30.063360 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da1532-9bd7-4c96-9473-1e29f40d517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:30.063981 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da1532-9bd7-4c96-9473-1e29f40d517b None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:30.064271 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da1532-9bd7-4c96-9473-1e29f40d517b None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:30.064537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da1532-9bd7-4c96-9473-1e29f40d517b None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:30.065159 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da1532-9bd7-4c96-9473-1e29f40d517b None admin] RBAC: Adding query filter params (name=image) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:30.065491 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da1532-9bd7-4c96-9473-1e29f40d517b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:30.066949 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da1532-9bd7-4c96-9473-1e29f40d517b None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:30.070572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3520e6-a433-4dd6-b162-99541ccc9542 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:30.072531 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 323/658] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:30.073697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da1532-9bd7-4c96-9473-1e29f40d517b None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:30.109138 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df20c8-cba6-441c-9deb-af6358ec2369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:30.109683 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df20c8-cba6-441c-9deb-af6358ec2369 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:30.109949 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df20c8-cba6-441c-9deb-af6358ec2369 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:30.110246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df20c8-cba6-441c-9deb-af6358ec2369 None admin] PATH_INFO: `/v3/services/network` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:30.110822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df20c8-cba6-441c-9deb-af6358ec2369 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:30.112202 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df20c8-cba6-441c-9deb-af6358ec2369 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-c3df20c8-cba6-441c-9deb-af6358ec2369 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:30.121449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:30.122536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:30.123584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 336/659] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:29 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:30.124398 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df20c8-cba6-441c-9deb-af6358ec2369 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:30.173979 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:30.209155 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da1532-9bd7-4c96-9473-1e29f40d517b None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:30.220004 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:30.230371 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df20c8-cba6-441c-9deb-af6358ec2369 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:30.246359 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f8b8f-e9a8-468d-8ea5-0a6eb1341245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:30.246995 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f8b8f-e9a8-468d-8ea5-0a6eb1341245 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:30.247885 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f8b8f-e9a8-468d-8ea5-0a6eb1341245 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:30.248160 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f8b8f-e9a8-468d-8ea5-0a6eb1341245 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:30.248797 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f8b8f-e9a8-468d-8ea5-0a6eb1341245 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:30.249096 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f8b8f-e9a8-468d-8ea5-0a6eb1341245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:30.250591 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f8b8f-e9a8-468d-8ea5-0a6eb1341245 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:30.254797 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 324/660] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 19:24:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:30.255557 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f8b8f-e9a8-468d-8ea5-0a6eb1341245 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:30.265371 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f76f6-829f-4e7c-b614-6e1d41914ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:30.267440 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f76f6-829f-4e7c-b614-6e1d41914ada None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:30.268561 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f76f6-829f-4e7c-b614-6e1d41914ada None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:30.270123 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f76f6-829f-4e7c-b614-6e1d41914ada None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:30.272797 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f76f6-829f-4e7c-b614-6e1d41914ada None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:30.273517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f76f6-829f-4e7c-b614-6e1d41914ada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:30.274932 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f76f6-829f-4e7c-b614-6e1d41914ada None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:30.287815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 337/661] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:30.288621 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f76f6-829f-4e7c-b614-6e1d41914ada None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:30.367747 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f8b8f-e9a8-468d-8ea5-0a6eb1341245 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:30.387961 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f76f6-829f-4e7c-b614-6e1d41914ada None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:30.403009 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee258a31-5d13-4959-a5af-225c7a7d4730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:30.404206 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee258a31-5d13-4959-a5af-225c7a7d4730 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:30.404526 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee258a31-5d13-4959-a5af-225c7a7d4730 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:30.404805 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee258a31-5d13-4959-a5af-225c7a7d4730 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:30.405460 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee258a31-5d13-4959-a5af-225c7a7d4730 None admin] RBAC: Adding query filter params (type=image) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:30.405759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee258a31-5d13-4959-a5af-225c7a7d4730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:30.407158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee258a31-5d13-4959-a5af-225c7a7d4730 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:30.410345 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:30.418349 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 325/662] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:30.419258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee258a31-5d13-4959-a5af-225c7a7d4730 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:30.424732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5a71f-809d-4047-97a2-44927477fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:30.425386 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a71f-809d-4047-97a2-44927477fb7e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:30.425651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a71f-809d-4047-97a2-44927477fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:30.425922 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a71f-809d-4047-97a2-44927477fb7e None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:30.426618 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5a71f-809d-4047-97a2-44927477fb7e None admin] RBAC: Adding query filter params (name=network) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:30.426923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5a71f-809d-4047-97a2-44927477fb7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:30.428409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5a71f-809d-4047-97a2-44927477fb7e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:30.439304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 338/663] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:24:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:30.439304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5a71f-809d-4047-97a2-44927477fb7e None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:30.461901 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:30.552621 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee258a31-5d13-4959-a5af-225c7a7d4730 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:30.566959 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5a71f-809d-4047-97a2-44927477fb7e None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:30.598361 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32dcbe-e869-402f-997f-538eb14ea931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:30.598972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dcbe-e869-402f-997f-538eb14ea931 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:30.599242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dcbe-e869-402f-997f-538eb14ea931 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:30.599614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dcbe-e869-402f-997f-538eb14ea931 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:30.600337 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32dcbe-e869-402f-997f-538eb14ea931 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:30.600643 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32dcbe-e869-402f-997f-538eb14ea931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:30.602035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32dcbe-e869-402f-997f-538eb14ea931 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:30.605873 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cbb3e-3f49-434e-8986-7295e2056724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:30.606576 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cbb3e-3f49-434e-8986-7295e2056724 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:30.606851 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cbb3e-3f49-434e-8986-7295e2056724 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:30.607118 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cbb3e-3f49-434e-8986-7295e2056724 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:30.614192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 326/664] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 19:24:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:30.614192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32dcbe-e869-402f-997f-538eb14ea931 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:30.621455 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cbb3e-3f49-434e-8986-7295e2056724 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:30.622911 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cbb3e-3f49-434e-8986-7295e2056724 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-ab5cbb3e-3f49-434e-8986-7295e2056724 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:30.639778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:30.648705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:30.648705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:30.648705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:30.648705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:30.648705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:30.648705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:30.648705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:30.648705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:30.648705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 339/665] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:30.648705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cbb3e-3f49-434e-8986-7295e2056724 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:30.701805 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:30.753688 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32dcbe-e869-402f-997f-538eb14ea931 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:30.754377 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:30.785325 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cbb3e-3f49-434e-8986-7295e2056724 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:30.796497 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61771b0f-be9d-4d8f-85c2-dc7b43fbc9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:30.797129 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61771b0f-be9d-4d8f-85c2-dc7b43fbc9c7 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:30.797460 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61771b0f-be9d-4d8f-85c2-dc7b43fbc9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:30.797735 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61771b0f-be9d-4d8f-85c2-dc7b43fbc9c7 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:30.798453 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61771b0f-be9d-4d8f-85c2-dc7b43fbc9c7 None admin] RBAC: Adding query filter params (type=network) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:30.798760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61771b0f-be9d-4d8f-85c2-dc7b43fbc9c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:30.800223 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61771b0f-be9d-4d8f-85c2-dc7b43fbc9c7 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:30.805894 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 327/666] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:24:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:30.831003 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741d043-bfb1-44f8-a51f-d025ffe442cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:30.831764 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741d043-bfb1-44f8-a51f-d025ffe442cf None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:30.832096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741d043-bfb1-44f8-a51f-d025ffe442cf None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:30.832429 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741d043-bfb1-44f8-a51f-d025ffe442cf None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:30.833207 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741d043-bfb1-44f8-a51f-d025ffe442cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:30.833572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741d043-bfb1-44f8-a51f-d025ffe442cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:30.835634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741d043-bfb1-44f8-a51f-d025ffe442cf None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:30.851379 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 340/667] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:30.857513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61771b0f-be9d-4d8f-85c2-dc7b43fbc9c7 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:30.972406 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61771b0f-be9d-4d8f-85c2-dc7b43fbc9c7 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:31.002437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:31.012244 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72dfe5-4a18-4e46-9c53-b21b0136c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:31.013081 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72dfe5-4a18-4e46-9c53-b21b0136c859 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:31.013361 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72dfe5-4a18-4e46-9c53-b21b0136c859 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:31.013644 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72dfe5-4a18-4e46-9c53-b21b0136c859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:31.014388 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72dfe5-4a18-4e46-9c53-b21b0136c859 None admin] RBAC: Adding query filter params (role.id=4ef4b944934e44a28a394ebd1a816f64, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=ff0c7740e6814c6c9515d0aed78bba68) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:31.014686 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72dfe5-4a18-4e46-9c53-b21b0136c859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:31.016129 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72dfe5-4a18-4e46-9c53-b21b0136c859 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:31.022481 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 328/668] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:24:30 2022] GET /identity/v3/role_assignments?user.id=ff0c7740e6814c6c9515d0aed78bba68&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:32.734501 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487268-fe1b-4047-aae3-ff22d7db754b None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:32.735252 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487268-fe1b-4047-aae3-ff22d7db754b None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:32.735252 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487268-fe1b-4047-aae3-ff22d7db754b None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:32.736627 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 341/669] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:32.742340 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e5fe4-57ef-47ca-a23c-abed35f213e7 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:32.742883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e5fe4-57ef-47ca-a23c-abed35f213e7 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:32.742883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e5fe4-57ef-47ca-a23c-abed35f213e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:32.761842 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-278e5fe4-57ef-47ca-a23c-abed35f213e7 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:32.763292 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-278e5fe4-57ef-47ca-a23c-abed35f213e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:32.889378 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 329/670] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:33.006666 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb201e0-7328-4f82-9bc7-54e0b87248e6 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:33.006973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb201e0-7328-4f82-9bc7-54e0b87248e6 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:33.007146 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb201e0-7328-4f82-9bc7-54e0b87248e6 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:33.008701 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 342/671] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:33.013917 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da7842-4f33-41ab-b86d-c177cfaa0d75 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:33.014254 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da7842-4f33-41ab-b86d-c177cfaa0d75 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:33.014528 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da7842-4f33-41ab-b86d-c177cfaa0d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:33.033347 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-49da7842-4f33-41ab-b86d-c177cfaa0d75 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:33.034614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-49da7842-4f33-41ab-b86d-c177cfaa0d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:33.106885 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 330/672] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:33.114149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f8343-e1cc-49fa-945e-e6c142e44cc4 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:33.114412 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f8343-e1cc-49fa-945e-e6c142e44cc4 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:33.114693 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f8343-e1cc-49fa-945e-e6c142e44cc4 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:33.116261 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 343/673] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:33.125014 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72d31b-5c17-469e-bb05-17d9a614d40c None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:33.125014 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72d31b-5c17-469e-bb05-17d9a614d40c None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:33.125014 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72d31b-5c17-469e-bb05-17d9a614d40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:33.141578 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-ae72d31b-5c17-469e-bb05-17d9a614d40c None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:33.143043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-ae72d31b-5c17-469e-bb05-17d9a614d40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:33.196148 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:33.219583 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 331/674] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:33.220921 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f8343-e1cc-49fa-945e-e6c142e44cc4 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:33.341786 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f8343-e1cc-49fa-945e-e6c142e44cc4 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:33.377974 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eb134-f209-44e7-84ef-caa579926261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:33.378604 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb134-f209-44e7-84ef-caa579926261 None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:33.378873 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb134-f209-44e7-84ef-caa579926261 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:33.379137 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb134-f209-44e7-84ef-caa579926261 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:33.379772 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eb134-f209-44e7-84ef-caa579926261 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:33.381233 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eb134-f209-44e7-84ef-caa579926261 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:33.384730 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:33.400873 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 344/675] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 19:24:33 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:33.444298 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309dad-799f-4dde-aa75-48160172eb25 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:33.444664 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309dad-799f-4dde-aa75-48160172eb25 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:33.444844 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309dad-799f-4dde-aa75-48160172eb25 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:33.446443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 332/676] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:33.453133 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05509125-0d4d-451e-8a03-cabc59df405d None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:33.453433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05509125-0d4d-451e-8a03-cabc59df405d None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:33.453676 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05509125-0d4d-451e-8a03-cabc59df405d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:33.475726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-05509125-0d4d-451e-8a03-cabc59df405d None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:33.477232 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-05509125-0d4d-451e-8a03-cabc59df405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:33.507040 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309dad-799f-4dde-aa75-48160172eb25 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:33.643457 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309dad-799f-4dde-aa75-48160172eb25 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:33.680587 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ad5a-b8c6-401c-9e0a-e212cb33c600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:33.681466 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ad5a-b8c6-401c-9e0a-e212cb33c600 None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:33.681741 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ad5a-b8c6-401c-9e0a-e212cb33c600 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:33.682190 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ad5a-b8c6-401c-9e0a-e212cb33c600 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:33.683182 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6ad5a-b8c6-401c-9e0a-e212cb33c600 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:33.684663 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6ad5a-b8c6-401c-9e0a-e212cb33c600 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:33.693845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 345/677] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:33 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:24:33.693845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05509125-0d4d-451e-8a03-cabc59df405d None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:33.722506 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 333/678] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 19:24:33 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:33.823963 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05509125-0d4d-451e-8a03-cabc59df405d None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:33.853836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:33.884227 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488de254-a225-4a59-90f9-3f23088696cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:33.884864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de254-a225-4a59-90f9-3f23088696cc None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:33.885139 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de254-a225-4a59-90f9-3f23088696cc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:33.885406 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de254-a225-4a59-90f9-3f23088696cc None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:33.890093 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488de254-a225-4a59-90f9-3f23088696cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:33.890093 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488de254-a225-4a59-90f9-3f23088696cc None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:33.908100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 346/679] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 19:24:33 2022] POST /identity/v3/services => generated 240 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:34.025061 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ad5a-b8c6-401c-9e0a-e212cb33c600 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:34.072157 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:34.137786 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ad5a-b8c6-401c-9e0a-e212cb33c600 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:34.180014 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddf8e7-a20e-497f-a34a-4c8aec40e2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:34.180566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddf8e7-a20e-497f-a34a-4c8aec40e2ee None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:34.180838 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddf8e7-a20e-497f-a34a-4c8aec40e2ee None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:34.181105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddf8e7-a20e-497f-a34a-4c8aec40e2ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:34.192043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddf8e7-a20e-497f-a34a-4c8aec40e2ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-ebddf8e7-a20e-497f-a34a-4c8aec40e2ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:34.196861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:34.197769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:34.198746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 334/680] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:24:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:34.204481 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488de254-a225-4a59-90f9-3f23088696cc None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:34.312182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488de254-a225-4a59-90f9-3f23088696cc None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:34.351596 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbaccd-8665-4298-8ab2-049f9a5f7531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:34.352685 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbaccd-8665-4298-8ab2-049f9a5f7531 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:34.353018 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbaccd-8665-4298-8ab2-049f9a5f7531 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:34.353292 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbaccd-8665-4298-8ab2-049f9a5f7531 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:34.353981 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbaccd-8665-4298-8ab2-049f9a5f7531 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:34.354316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbaccd-8665-4298-8ab2-049f9a5f7531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:34.355767 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbaccd-8665-4298-8ab2-049f9a5f7531 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:34.365221 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 347/681] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:34.370879 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddf8e7-a20e-497f-a34a-4c8aec40e2ee None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:34.468421 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:34.475806 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddf8e7-a20e-497f-a34a-4c8aec40e2ee None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:34.511356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d601f0-64c0-4785-89d3-70f1fea589cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:34.511993 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d601f0-64c0-4785-89d3-70f1fea589cb None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:34.512267 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d601f0-64c0-4785-89d3-70f1fea589cb None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:34.512618 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d601f0-64c0-4785-89d3-70f1fea589cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:34.523505 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d601f0-64c0-4785-89d3-70f1fea589cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:34.524975 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d601f0-64c0-4785-89d3-70f1fea589cb None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-40d601f0-64c0-4785-89d3-70f1fea589cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:34.540218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:34.542839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:34.545001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:34.545001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:34.545001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:34.545001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 335/682] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:34.547938 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbaccd-8665-4298-8ab2-049f9a5f7531 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:34.594376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:34.655187 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbaccd-8665-4298-8ab2-049f9a5f7531 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:34.690715 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f816f8-96c3-4720-be2c-9e8858c1172a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:34.691327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f816f8-96c3-4720-be2c-9e8858c1172a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:34.691604 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f816f8-96c3-4720-be2c-9e8858c1172a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:34.691874 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f816f8-96c3-4720-be2c-9e8858c1172a None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:34.692513 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f816f8-96c3-4720-be2c-9e8858c1172a None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:34.692813 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f816f8-96c3-4720-be2c-9e8858c1172a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:34.694213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f816f8-96c3-4720-be2c-9e8858c1172a None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:34.707088 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 348/683] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:34.712760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d601f0-64c0-4785-89d3-70f1fea589cb None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:34.814416 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d601f0-64c0-4785-89d3-70f1fea589cb None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:34.848520 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004a47f-46d3-4c84-996b-6b0fd2a45482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:34.849148 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a47f-46d3-4c84-996b-6b0fd2a45482 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:34.849416 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a47f-46d3-4c84-996b-6b0fd2a45482 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:34.849675 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a47f-46d3-4c84-996b-6b0fd2a45482 None admin] PATH_INFO: `/v3/users/nova` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:34.857442 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004a47f-46d3-4c84-996b-6b0fd2a45482 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:34.858918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004a47f-46d3-4c84-996b-6b0fd2a45482 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-d004a47f-46d3-4c84-996b-6b0fd2a45482 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:34.870118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:34.872233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:34.873916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:34.873916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:34.873916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:34.873916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:34.873916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:34.873916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:34.873916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:34.873916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:34.873916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:34.873916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:34.873916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 336/684] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 19:24:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:34.877712 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f816f8-96c3-4720-be2c-9e8858c1172a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:34.986132 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f816f8-96c3-4720-be2c-9e8858c1172a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:34.987704 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:35.021296 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f370-a48d-41c9-b037-691162ab93f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:35.021907 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f370-a48d-41c9-b037-691162ab93f5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:35.022211 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f370-a48d-41c9-b037-691162ab93f5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:35.022478 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f370-a48d-41c9-b037-691162ab93f5 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:35.023200 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927f370-a48d-41c9-b037-691162ab93f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:35.023504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927f370-a48d-41c9-b037-691162ab93f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:35.024944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927f370-a48d-41c9-b037-691162ab93f5 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:35.043949 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 349/685] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 19:24:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:35.049501 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004a47f-46d3-4c84-996b-6b0fd2a45482 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:35.059360 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:35.159333 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004a47f-46d3-4c84-996b-6b0fd2a45482 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:35.202046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d612ad-2408-434b-bc28-2d1c5c77d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:35.202046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d612ad-2408-434b-bc28-2d1c5c77d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:35.202046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d612ad-2408-434b-bc28-2d1c5c77d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:35.202046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d612ad-2408-434b-bc28-2d1c5c77d6a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:35.208687 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d612ad-2408-434b-bc28-2d1c5c77d6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:35.210167 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d612ad-2408-434b-bc28-2d1c5c77d6a8 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-60d612ad-2408-434b-bc28-2d1c5c77d6a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:35.224827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:35.225793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:35.227331 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:35.227331 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:35.227331 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:35.227331 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 337/686] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:35.231876 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f370-a48d-41c9-b037-691162ab93f5 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:35.337957 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f370-a48d-41c9-b037-691162ab93f5 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:35.373185 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d1457-7197-4138-a599-7ecf86ebf22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:35.373793 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1457-7197-4138-a599-7ecf86ebf22a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:35.374092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1457-7197-4138-a599-7ecf86ebf22a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:35.374364 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1457-7197-4138-a599-7ecf86ebf22a None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:35.374995 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d1457-7197-4138-a599-7ecf86ebf22a None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:35.375292 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d1457-7197-4138-a599-7ecf86ebf22a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:35.376716 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d1457-7197-4138-a599-7ecf86ebf22a None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:35.388791 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 350/687] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:35.395128 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d612ad-2408-434b-bc28-2d1c5c77d6a8 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:35.455142 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:35.498800 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d612ad-2408-434b-bc28-2d1c5c77d6a8 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:35.533700 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73762-285b-4e31-80a0-ab03e8bb1319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:35.534358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73762-285b-4e31-80a0-ab03e8bb1319 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:35.534629 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73762-285b-4e31-80a0-ab03e8bb1319 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:35.534895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73762-285b-4e31-80a0-ab03e8bb1319 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:35.542242 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc73762-285b-4e31-80a0-ab03e8bb1319 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:35.543729 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc73762-285b-4e31-80a0-ab03e8bb1319 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-0bc73762-285b-4e31-80a0-ab03e8bb1319 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:35.555455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:35.556366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:35.557859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:35.557859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:35.557859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:35.557859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:35.557859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:35.557859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:35.557859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:35.557859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:35.557859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 338/688] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:35.567864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d1457-7197-4138-a599-7ecf86ebf22a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:35.596089 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:35.694607 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d1457-7197-4138-a599-7ecf86ebf22a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:35.729868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8308e-657f-4391-b807-9a1883b1752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:35.730429 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8308e-657f-4391-b807-9a1883b1752d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:35.730706 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8308e-657f-4391-b807-9a1883b1752d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:35.730980 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8308e-657f-4391-b807-9a1883b1752d None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:35.732100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8308e-657f-4391-b807-9a1883b1752d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:35.732689 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8308e-657f-4391-b807-9a1883b1752d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:35.734985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8308e-657f-4391-b807-9a1883b1752d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:35.748253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 351/689] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:35.755093 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73762-285b-4e31-80a0-ab03e8bb1319 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:35.838072 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79206e5a-5523-4b0a-ac93-1edc271fde6d None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:35.838683 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79206e5a-5523-4b0a-ac93-1edc271fde6d None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:35.839152 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79206e5a-5523-4b0a-ac93-1edc271fde6d None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:35.840946 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 352/690] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:35.846780 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab502f-e99b-45e6-9fab-a55ae8aa5660 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:35.847285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab502f-e99b-45e6-9fab-a55ae8aa5660 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:35.847754 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab502f-e99b-45e6-9fab-a55ae8aa5660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:35.860170 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73762-285b-4e31-80a0-ab03e8bb1319 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:35.868114 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-20ab502f-e99b-45e6-9fab-a55ae8aa5660 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:35.869620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-20ab502f-e99b-45e6-9fab-a55ae8aa5660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:35.883764 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:35.910457 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ffdf3-84a1-4432-a3fa-fd4dd6b988af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:35.911547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ffdf3-84a1-4432-a3fa-fd4dd6b988af None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:35.911547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ffdf3-84a1-4432-a3fa-fd4dd6b988af None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:35.911985 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ffdf3-84a1-4432-a3fa-fd4dd6b988af None admin] PATH_INFO: `/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/ff0c7740e6814c6c9515d0aed78bba68/roles/4ef4b944934e44a28a394ebd1a816f64` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:35.914082 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ffdf3-84a1-4432-a3fa-fd4dd6b988af None admin] RBAC: Authorizing `identity:create_grant(project_id=a186fc1651b442d4b704b88a3dddf1b0, user_id=ff0c7740e6814c6c9515d0aed78bba68, role_id=4ef4b944934e44a28a394ebd1a816f64)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:35.916063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ffdf3-84a1-4432-a3fa-fd4dd6b988af None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:35.938023 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 339/691] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:24:35 2022] PUT /identity/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/ff0c7740e6814c6c9515d0aed78bba68/roles/4ef4b944934e44a28a394ebd1a816f64 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:24:35.964866 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 353/692] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:35 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:24:36.050715 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc163c95-f182-4cbd-b842-df4ebb61502e None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:36.051271 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc163c95-f182-4cbd-b842-df4ebb61502e None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:36.051271 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc163c95-f182-4cbd-b842-df4ebb61502e None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:36.052971 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 340/693] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:36.058755 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ad18d-12d4-414d-94d0-60f00b07f025 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:36.059033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ad18d-12d4-414d-94d0-60f00b07f025 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:36.059427 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ad18d-12d4-414d-94d0-60f00b07f025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:36.079381 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-d16ad18d-12d4-414d-94d0-60f00b07f025 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:36.080611 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-d16ad18d-12d4-414d-94d0-60f00b07f025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:36.084942 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:36.159674 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 354/694] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:36 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:36.299491 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc163c95-f182-4cbd-b842-df4ebb61502e None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:36.340388 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52346f6-8270-490e-a998-684d11aaf0bf None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:36.340946 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52346f6-8270-490e-a998-684d11aaf0bf None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:36.340946 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52346f6-8270-490e-a998-684d11aaf0bf None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:36.342680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 355/695] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:24:36.347735 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70d7f0-7f25-4331-af76-6b368ba85fda None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:36.348308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70d7f0-7f25-4331-af76-6b368ba85fda None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:36.348782 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70d7f0-7f25-4331-af76-6b368ba85fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:36.368539 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-2b70d7f0-7f25-4331-af76-6b368ba85fda None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:36.370113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-2b70d7f0-7f25-4331-af76-6b368ba85fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:36.425303 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc163c95-f182-4cbd-b842-df4ebb61502e None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:36.449786 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 356/696] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:36 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:24:36.470708 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55497d92-23ee-4932-91b6-d99bc137d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:36.471709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497d92-23ee-4932-91b6-d99bc137d912 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:36.472159 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497d92-23ee-4932-91b6-d99bc137d912 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:36.472622 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497d92-23ee-4932-91b6-d99bc137d912 None admin] PATH_INFO: `/v3/services/image` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:36.473363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497d92-23ee-4932-91b6-d99bc137d912 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:36.474951 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497d92-23ee-4932-91b6-d99bc137d912 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-55497d92-23ee-4932-91b6-d99bc137d912 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:36.484653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:36.485857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:24:36.486948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:36.489435 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 341/697] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Aug 19 19:24:36 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:36.494949 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70d7f0-7f25-4331-af76-6b368ba85fda None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:36.518171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55497d92-23ee-4932-91b6-d99bc137d912 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:36.599672 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:36.621215 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70d7f0-7f25-4331-af76-6b368ba85fda None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:36.660528 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60571bd-c1d7-44cb-b5fa-9c530c7b77e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:36.661443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60571bd-c1d7-44cb-b5fa-9c530c7b77e1 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:36.661950 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60571bd-c1d7-44cb-b5fa-9c530c7b77e1 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:36.662342 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60571bd-c1d7-44cb-b5fa-9c530c7b77e1 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:36.663146 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60571bd-c1d7-44cb-b5fa-9c530c7b77e1 None admin] RBAC: Adding query filter params (name=image) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:36.663541 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60571bd-c1d7-44cb-b5fa-9c530c7b77e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:36.665550 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60571bd-c1d7-44cb-b5fa-9c530c7b77e1 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:36.671875 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 357/698] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:36.677031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60571bd-c1d7-44cb-b5fa-9c530c7b77e1 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:36.694488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:36.753079 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55497d92-23ee-4932-91b6-d99bc137d912 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:36.785845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60571bd-c1d7-44cb-b5fa-9c530c7b77e1 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:36.788598 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6689d0b-bd8c-4e97-8879-0e4e8d1a6b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:36.789610 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6689d0b-bd8c-4e97-8879-0e4e8d1a6b7b None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:36.789733 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6689d0b-bd8c-4e97-8879-0e4e8d1a6b7b None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:36.790129 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6689d0b-bd8c-4e97-8879-0e4e8d1a6b7b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:36.791146 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6689d0b-bd8c-4e97-8879-0e4e8d1a6b7b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:36.792627 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6689d0b-bd8c-4e97-8879-0e4e8d1a6b7b None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-d6689d0b-bd8c-4e97-8879-0e4e8d1a6b7b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:36.801874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:36.803158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:24:36.804194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:36.810221 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 342/699] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Aug 19 19:24:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:36.811087 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6689d0b-bd8c-4e97-8879-0e4e8d1a6b7b None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:36.828835 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6ab56-68b3-4193-b6b5-aef00cc22337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:36.829448 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6ab56-68b3-4193-b6b5-aef00cc22337 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:36.829727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6ab56-68b3-4193-b6b5-aef00cc22337 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:36.830030 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6ab56-68b3-4193-b6b5-aef00cc22337 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:36.830670 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6ab56-68b3-4193-b6b5-aef00cc22337 None admin] RBAC: Adding query filter params (type=image) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:36.830972 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6ab56-68b3-4193-b6b5-aef00cc22337 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:36.832354 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6ab56-68b3-4193-b6b5-aef00cc22337 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:36.833759 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:36.844950 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 358/700] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:36.846010 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6ab56-68b3-4193-b6b5-aef00cc22337 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:36.928438 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6689d0b-bd8c-4e97-8879-0e4e8d1a6b7b None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:36.936542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:36.961891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6ab56-68b3-4193-b6b5-aef00cc22337 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:36.966946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd3200-e732-446d-9a84-ec6bbe5a5277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:36.967578 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3200-e732-446d-9a84-ec6bbe5a5277 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:36.967841 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3200-e732-446d-9a84-ec6bbe5a5277 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:36.968115 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3200-e732-446d-9a84-ec6bbe5a5277 None admin] PATH_INFO: `/v3/services/network` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:36.968696 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd3200-e732-446d-9a84-ec6bbe5a5277 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:36.970097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd3200-e732-446d-9a84-ec6bbe5a5277 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-29bd3200-e732-446d-9a84-ec6bbe5a5277 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:36.979386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:36.980409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:24:36.981414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:36.986194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 343/701] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:36 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:36.986780 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd3200-e732-446d-9a84-ec6bbe5a5277 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:37.011332 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88da091-e98a-411c-8457-b608063c6ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:37.012092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88da091-e98a-411c-8457-b608063c6ede None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:37.012398 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88da091-e98a-411c-8457-b608063c6ede None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:37.012906 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88da091-e98a-411c-8457-b608063c6ede None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:37.013615 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88da091-e98a-411c-8457-b608063c6ede None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:37.013918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88da091-e98a-411c-8457-b608063c6ede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:37.016422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88da091-e98a-411c-8457-b608063c6ede None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:37.024423 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 359/702] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 19:24:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:37.025234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88da091-e98a-411c-8457-b608063c6ede None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:37.092678 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:37.096314 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd3200-e732-446d-9a84-ec6bbe5a5277 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:37.135368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88da091-e98a-411c-8457-b608063c6ede None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:37.136378 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8018476-2ac1-44e7-a170-288292bbd10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:37.136997 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8018476-2ac1-44e7-a170-288292bbd10c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:37.137279 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8018476-2ac1-44e7-a170-288292bbd10c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:37.137661 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8018476-2ac1-44e7-a170-288292bbd10c None admin] PATH_INFO: `/v3/endpoints` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:37.138405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8018476-2ac1-44e7-a170-288292bbd10c None admin] RBAC: Adding query filter params (interface=public, service_id=bcc2f0dacf0c4bb5979288b28e4ce231, region_id=RegionOne) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:37.138710 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8018476-2ac1-44e7-a170-288292bbd10c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:37.140076 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8018476-2ac1-44e7-a170-288292bbd10c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:37.152567 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 344/703] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 19:24:36 2022] GET /identity/v3/endpoints?service_id=bcc2f0dacf0c4bb5979288b28e4ce231&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:37.152567 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8018476-2ac1-44e7-a170-288292bbd10c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:37.177945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc49687-3256-4dcd-bc18-3163c88d6574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:37.178739 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc49687-3256-4dcd-bc18-3163c88d6574 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:37.178966 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc49687-3256-4dcd-bc18-3163c88d6574 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:37.179243 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc49687-3256-4dcd-bc18-3163c88d6574 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:37.179874 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc49687-3256-4dcd-bc18-3163c88d6574 None admin] RBAC: Adding query filter params (name=network) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:37.180177 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc49687-3256-4dcd-bc18-3163c88d6574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:37.181555 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc49687-3256-4dcd-bc18-3163c88d6574 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:37.189409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:37.191033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 360/704] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:24:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:37.191918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc49687-3256-4dcd-bc18-3163c88d6574 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:37.265752 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8018476-2ac1-44e7-a170-288292bbd10c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:37.300028 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75ba92-d5b5-42b6-bb9d-9fb9629a7611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:37.303167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc49687-3256-4dcd-bc18-3163c88d6574 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:37.304740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75ba92-d5b5-42b6-bb9d-9fb9629a7611 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:37.305025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75ba92-d5b5-42b6-bb9d-9fb9629a7611 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:37.305294 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75ba92-d5b5-42b6-bb9d-9fb9629a7611 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:37.305943 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75ba92-d5b5-42b6-bb9d-9fb9629a7611 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:37.307448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75ba92-d5b5-42b6-bb9d-9fb9629a7611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:37.307786 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75ba92-d5b5-42b6-bb9d-9fb9629a7611 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:37.314785 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 345/705] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 19:24:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:37.314938 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75ba92-d5b5-42b6-bb9d-9fb9629a7611 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:37.341402 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:37.353032 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d757f49-2a79-4396-8d54-880b5ca56647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:37.354046 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d757f49-2a79-4396-8d54-880b5ca56647 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:37.354461 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d757f49-2a79-4396-8d54-880b5ca56647 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:37.354862 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d757f49-2a79-4396-8d54-880b5ca56647 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:37.355643 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d757f49-2a79-4396-8d54-880b5ca56647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:37.357149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d757f49-2a79-4396-8d54-880b5ca56647 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:37.362886 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 361/706] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 19:24:37 2022] GET /identity/v3/services => generated 1002 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:24:37.363818 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d757f49-2a79-4396-8d54-880b5ca56647 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:37.432425 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:37.438293 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75ba92-d5b5-42b6-bb9d-9fb9629a7611 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:37.479031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dbec9-75f2-4d15-b07c-470a3e51fa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:37.480083 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dbec9-75f2-4d15-b07c-470a3e51fa4d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:37.480566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dbec9-75f2-4d15-b07c-470a3e51fa4d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:37.481099 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dbec9-75f2-4d15-b07c-470a3e51fa4d None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:37.482108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dbec9-75f2-4d15-b07c-470a3e51fa4d None admin] RBAC: Adding query filter params (type=network) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:37.482649 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dbec9-75f2-4d15-b07c-470a3e51fa4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:37.484447 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dbec9-75f2-4d15-b07c-470a3e51fa4d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:37.488342 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d757f49-2a79-4396-8d54-880b5ca56647 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:37.496264 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 346/707] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:24:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:37.498255 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dbec9-75f2-4d15-b07c-470a3e51fa4d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:37.531061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26e82f-9272-43a1-bfad-cb84b5e69d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:37.531612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e82f-9272-43a1-bfad-cb84b5e69d9c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:37.531886 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e82f-9272-43a1-bfad-cb84b5e69d9c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:37.532150 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e82f-9272-43a1-bfad-cb84b5e69d9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:37.532912 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26e82f-9272-43a1-bfad-cb84b5e69d9c None admin] RBAC: Adding query filter params (interface=public, service_id=d6fb682e8a6e49e6933f2dcf4c067b46, region_id=RegionOne) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:37.533260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26e82f-9272-43a1-bfad-cb84b5e69d9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:37.534813 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26e82f-9272-43a1-bfad-cb84b5e69d9c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:37.548986 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 362/708] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 19:24:37 2022] GET /identity/v3/endpoints?service_id=d6fb682e8a6e49e6933f2dcf4c067b46&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:37.551336 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26e82f-9272-43a1-bfad-cb84b5e69d9c None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:37.622222 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:37.624679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dbec9-75f2-4d15-b07c-470a3e51fa4d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:37.660552 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0f88-27ff-43ee-83c0-389447b664d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:37.661357 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0f88-27ff-43ee-83c0-389447b664d7 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:37.661473 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0f88-27ff-43ee-83c0-389447b664d7 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:37.661690 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0f88-27ff-43ee-83c0-389447b664d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:37.662441 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0f88-27ff-43ee-83c0-389447b664d7 None admin] RBAC: Adding query filter params (interface=public, service_id=f9d6a2ebcfd747c2be4c0285a572c0c8, region_id=RegionOne) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:37.662775 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0f88-27ff-43ee-83c0-389447b664d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:37.664155 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0f88-27ff-43ee-83c0-389447b664d7 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:37.676126 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 347/709] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 19:24:37 2022] GET /identity/v3/endpoints?service_id=f9d6a2ebcfd747c2be4c0285a572c0c8&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:37.678361 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0f88-27ff-43ee-83c0-389447b664d7 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:37.686979 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26e82f-9272-43a1-bfad-cb84b5e69d9c None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:37.721348 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:37.727235 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94190c40-eb14-45ec-a1b7-4d9f59a3efd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:37.728138 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190c40-eb14-45ec-a1b7-4d9f59a3efd8 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:37.728621 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190c40-eb14-45ec-a1b7-4d9f59a3efd8 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:37.729308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190c40-eb14-45ec-a1b7-4d9f59a3efd8 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:37.730225 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94190c40-eb14-45ec-a1b7-4d9f59a3efd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:37.732098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94190c40-eb14-45ec-a1b7-4d9f59a3efd8 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:37.738790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 363/710] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 19:24:37 2022] GET /identity/v3/services => generated 1002 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:24:37.815548 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0f88-27ff-43ee-83c0-389447b664d7 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:37.854690 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec097d5d-53ed-4f20-a6e4-c28f6ad7f3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:37.855304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec097d5d-53ed-4f20-a6e4-c28f6ad7f3f2 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:37.855571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec097d5d-53ed-4f20-a6e4-c28f6ad7f3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:37.855836 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec097d5d-53ed-4f20-a6e4-c28f6ad7f3f2 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:37.856511 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec097d5d-53ed-4f20-a6e4-c28f6ad7f3f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:37.857886 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec097d5d-53ed-4f20-a6e4-c28f6ad7f3f2 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:37.870181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 348/711] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 19:24:37 2022] GET /identity/v3/services => generated 1002 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:24:38.239590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373141e8-0e87-4f96-b92e-572cf0960606 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:38.240598 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373141e8-0e87-4f96-b92e-572cf0960606 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:38.241070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373141e8-0e87-4f96-b92e-572cf0960606 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:38.242893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 364/712] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:38.248824 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62322029-5148-4e11-8369-7bf7b747adb0 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:38.249297 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62322029-5148-4e11-8369-7bf7b747adb0 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:38.249378 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62322029-5148-4e11-8369-7bf7b747adb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:38.267816 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-62322029-5148-4e11-8369-7bf7b747adb0 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:38.269002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-62322029-5148-4e11-8369-7bf7b747adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:38.339914 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 349/713] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:38.670910 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373141e8-0e87-4f96-b92e-572cf0960606 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:38.787034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373141e8-0e87-4f96-b92e-572cf0960606 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:38.807484 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:38.826957 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fa76a-77e7-4e50-976b-e0e04bcbfe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:38.827706 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fa76a-77e7-4e50-976b-e0e04bcbfe48 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:38.827978 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fa76a-77e7-4e50-976b-e0e04bcbfe48 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:38.828245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fa76a-77e7-4e50-976b-e0e04bcbfe48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:38.838937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fa76a-77e7-4e50-976b-e0e04bcbfe48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-a94fa76a-77e7-4e50-976b-e0e04bcbfe48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:24:38.844021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:38.844945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:38.845807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 365/714] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:38.852953 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62322029-5148-4e11-8369-7bf7b747adb0 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:38.876356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:38.966864 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62322029-5148-4e11-8369-7bf7b747adb0 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:39.002502 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b1bde-0d16-41a4-8ad6-6eced02d2860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:39.003120 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b1bde-0d16-41a4-8ad6-6eced02d2860 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:39.003391 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b1bde-0d16-41a4-8ad6-6eced02d2860 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:39.003657 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b1bde-0d16-41a4-8ad6-6eced02d2860 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:39.004397 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b1bde-0d16-41a4-8ad6-6eced02d2860 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:39.004692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b1bde-0d16-41a4-8ad6-6eced02d2860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:39.006150 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b1bde-0d16-41a4-8ad6-6eced02d2860 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:39.016277 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 350/715] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:39.022166 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fa76a-77e7-4e50-976b-e0e04bcbfe48 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:39.128681 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fa76a-77e7-4e50-976b-e0e04bcbfe48 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:39.164141 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699e7db-9c01-4264-acbe-2565a8fb7b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:39.164778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699e7db-9c01-4264-acbe-2565a8fb7b03 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:39.165113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699e7db-9c01-4264-acbe-2565a8fb7b03 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:39.165387 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699e7db-9c01-4264-acbe-2565a8fb7b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:39.176320 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699e7db-9c01-4264-acbe-2565a8fb7b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:39.177782 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699e7db-9c01-4264-acbe-2565a8fb7b03 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-5699e7db-9c01-4264-acbe-2565a8fb7b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:39.196864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:39.197844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:39.198766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:39.198766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:39.198766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:39.198766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 366/716] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:39.206377 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b1bde-0d16-41a4-8ad6-6eced02d2860 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:39.300202 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:39.319836 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b1bde-0d16-41a4-8ad6-6eced02d2860 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:39.355006 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d2b3a-807d-42d2-91b7-0aee9b64ee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:39.355608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2b3a-807d-42d2-91b7-0aee9b64ee61 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:39.355877 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2b3a-807d-42d2-91b7-0aee9b64ee61 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:39.356199 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2b3a-807d-42d2-91b7-0aee9b64ee61 None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:39.356834 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d2b3a-807d-42d2-91b7-0aee9b64ee61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:39.357121 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d2b3a-807d-42d2-91b7-0aee9b64ee61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:39.358527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d2b3a-807d-42d2-91b7-0aee9b64ee61 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:39.371761 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 351/717] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:39.377861 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699e7db-9c01-4264-acbe-2565a8fb7b03 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:39.416020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:39.491543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699e7db-9c01-4264-acbe-2565a8fb7b03 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:39.530593 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b20d8-1b0c-4601-9ede-29264db1106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:39.531239 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b20d8-1b0c-4601-9ede-29264db1106c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:39.531509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b20d8-1b0c-4601-9ede-29264db1106c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:39.531783 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b20d8-1b0c-4601-9ede-29264db1106c None admin] PATH_INFO: `/v3/users/nova` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:39.539571 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b20d8-1b0c-4601-9ede-29264db1106c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:39.541379 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b20d8-1b0c-4601-9ede-29264db1106c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-ef1b20d8-1b0c-4601-9ede-29264db1106c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:24:39.555636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:39.556597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:39.557622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:39.557622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:39.557622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:24:39.557622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:24:39.557622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:24:39.557622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:24:39.557622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:24:39.557622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:24:39.557622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:24:39.557622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:39.557622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 367/718] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 19:24:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:39.564508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d2b3a-807d-42d2-91b7-0aee9b64ee61 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:39.654835 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4fda8-3dc1-4891-9cc5-c8d1b0d9ffdb None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:39.655208 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4fda8-3dc1-4891-9cc5-c8d1b0d9ffdb None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:39.655517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4fda8-3dc1-4891-9cc5-c8d1b0d9ffdb None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:39.657471 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 368/719] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:24:39.662532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1fd9c-7c94-400e-acb9-f4aa33644ab4 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:39.662822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1fd9c-7c94-400e-acb9-f4aa33644ab4 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:39.663091 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1fd9c-7c94-400e-acb9-f4aa33644ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:39.680289 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d2b3a-807d-42d2-91b7-0aee9b64ee61 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:39.684003 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-1ce1fd9c-7c94-400e-acb9-f4aa33644ab4 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:39.685428 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-1ce1fd9c-7c94-400e-acb9-f4aa33644ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:39.722713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc77c6-ee09-4f71-aa77-e63de940833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:39.724207 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc77c6-ee09-4f71-aa77-e63de940833d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:39.724480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc77c6-ee09-4f71-aa77-e63de940833d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:39.724742 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc77c6-ee09-4f71-aa77-e63de940833d None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:39.725525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc77c6-ee09-4f71-aa77-e63de940833d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:39.725822 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc77c6-ee09-4f71-aa77-e63de940833d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:39.727291 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc77c6-ee09-4f71-aa77-e63de940833d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:39.747224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:39.752607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 352/720] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 19:24:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:39.757955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc77c6-ee09-4f71-aa77-e63de940833d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:39.774151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 369/721] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:39 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:39.864551 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc77c6-ee09-4f71-aa77-e63de940833d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:39.904840 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b49f8-c25e-4105-bc6a-c9a5ef3b8e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:39.905910 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b49f8-c25e-4105-bc6a-c9a5ef3b8e7f None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:39.906409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b49f8-c25e-4105-bc6a-c9a5ef3b8e7f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:39.906865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b49f8-c25e-4105-bc6a-c9a5ef3b8e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:39.978317 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:39.981816 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b49f8-c25e-4105-bc6a-c9a5ef3b8e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:39.984321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b49f8-c25e-4105-bc6a-c9a5ef3b8e7f None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:40.050488 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304026-6d4b-4fbd-b1a2-4af3e2764cb1 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.050689 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304026-6d4b-4fbd-b1a2-4af3e2764cb1 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.050966 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304026-6d4b-4fbd-b1a2-4af3e2764cb1 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.052560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 370/722] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:24:40.057340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85089fe-23db-4390-8ee2-571e6769323c None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.057620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85089fe-23db-4390-8ee2-571e6769323c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.057891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85089fe-23db-4390-8ee2-571e6769323c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.079273 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-b85089fe-23db-4390-8ee2-571e6769323c None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:40.080471 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-b85089fe-23db-4390-8ee2-571e6769323c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:40.094408 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 353/723] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:39 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 19:24:40.106043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:40.106291 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b49f8-c25e-4105-bc6a-c9a5ef3b8e7f None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:40.166094 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 371/724] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:40 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:24:40.166778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85089fe-23db-4390-8ee2-571e6769323c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:40.220790 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:40.224147 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b49f8-c25e-4105-bc6a-c9a5ef3b8e7f None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:40.259532 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536061e-b042-4e6a-922b-b0d8284150d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:40.260245 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536061e-b042-4e6a-922b-b0d8284150d4 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.260523 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536061e-b042-4e6a-922b-b0d8284150d4 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.260796 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536061e-b042-4e6a-922b-b0d8284150d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.271586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536061e-b042-4e6a-922b-b0d8284150d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:40.273063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536061e-b042-4e6a-922b-b0d8284150d4 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:40.276505 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85089fe-23db-4390-8ee2-571e6769323c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-4536061e-b042-4e6a-922b-b0d8284150d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:40.288488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:40.289452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:40.290376 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:40.290376 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:40.290376 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:40.290376 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 354/725] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:40.291328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689d128-567f-4927-820f-4d57f08617f9 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.291328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689d128-567f-4927-820f-4d57f08617f9 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.291592 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689d128-567f-4927-820f-4d57f08617f9 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.295529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 355/726] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:40.295944 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689d128-567f-4927-820f-4d57f08617f9 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:40.320905 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c37d8-2f78-4279-9b64-0b9ec9fb45a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:40.321705 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c37d8-2f78-4279-9b64-0b9ec9fb45a0 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.321981 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c37d8-2f78-4279-9b64-0b9ec9fb45a0 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.322292 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c37d8-2f78-4279-9b64-0b9ec9fb45a0 None admin] PATH_INFO: `/v3/services/image` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.322898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c37d8-2f78-4279-9b64-0b9ec9fb45a0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:40.324482 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c37d8-2f78-4279-9b64-0b9ec9fb45a0 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-a79c37d8-2f78-4279-9b64-0b9ec9fb45a0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:40.333858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:40.334868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:40.339131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 372/727] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Aug 19 19:24:40 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:40.339920 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbdeb-c0b9-40cd-b3d0-a1aeafd5d2a9 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.339920 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbdeb-c0b9-40cd-b3d0-a1aeafd5d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.339920 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbdeb-c0b9-40cd-b3d0-a1aeafd5d2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.355911 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-c29bbdeb-c0b9-40cd-b3d0-a1aeafd5d2a9 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:40.357701 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-c29bbdeb-c0b9-40cd-b3d0-a1aeafd5d2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:40.367677 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:40.404875 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689d128-567f-4927-820f-4d57f08617f9 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:40.434558 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 373/728] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:40 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:40.434558 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bbdeb-c0b9-40cd-b3d0-a1aeafd5d2a9 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:40.459449 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95017182-2840-47b5-a77f-9b3cde4ef2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:40.460555 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95017182-2840-47b5-a77f-9b3cde4ef2db None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.460994 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95017182-2840-47b5-a77f-9b3cde4ef2db None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.461603 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95017182-2840-47b5-a77f-9b3cde4ef2db None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.462803 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95017182-2840-47b5-a77f-9b3cde4ef2db None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:40.463475 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95017182-2840-47b5-a77f-9b3cde4ef2db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:40.465637 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95017182-2840-47b5-a77f-9b3cde4ef2db None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:40.482056 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 356/729] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:40.486547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95017182-2840-47b5-a77f-9b3cde4ef2db None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:40.501032 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:40.539248 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bbdeb-c0b9-40cd-b3d0-a1aeafd5d2a9 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:40.575988 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa365e8-81f3-4dd8-bc63-a63458ffaa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:40.576596 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa365e8-81f3-4dd8-bc63-a63458ffaa89 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.576869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa365e8-81f3-4dd8-bc63-a63458ffaa89 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.577135 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa365e8-81f3-4dd8-bc63-a63458ffaa89 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.577762 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa365e8-81f3-4dd8-bc63-a63458ffaa89 None admin] RBAC: Adding query filter params (name=image) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:40.578085 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa365e8-81f3-4dd8-bc63-a63458ffaa89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:40.579464 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa365e8-81f3-4dd8-bc63-a63458ffaa89 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:40.586045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 374/730] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:40.586045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa365e8-81f3-4dd8-bc63-a63458ffaa89 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:40.599149 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95017182-2840-47b5-a77f-9b3cde4ef2db None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:40.600508 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:40.634365 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305673e-b4e9-42d4-8204-ac51711e2ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:40.635095 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305673e-b4e9-42d4-8204-ac51711e2ee2 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.635369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305673e-b4e9-42d4-8204-ac51711e2ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.635646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305673e-b4e9-42d4-8204-ac51711e2ee2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.636204 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305673e-b4e9-42d4-8204-ac51711e2ee2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:40.637764 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305673e-b4e9-42d4-8204-ac51711e2ee2 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-1305673e-b4e9-42d4-8204-ac51711e2ee2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:40.647197 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:40.648183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:40.649041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 357/731] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Aug 19 19:24:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:40.649848 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305673e-b4e9-42d4-8204-ac51711e2ee2 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:40.701657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa365e8-81f3-4dd8-bc63-a63458ffaa89 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:40.731602 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:40.742281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107078c-50d0-422f-86bb-e607a1d1524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:40.742922 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107078c-50d0-422f-86bb-e607a1d1524e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.743173 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107078c-50d0-422f-86bb-e607a1d1524e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.743440 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107078c-50d0-422f-86bb-e607a1d1524e None admin] PATH_INFO: `/v3/projects/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.750585 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107078c-50d0-422f-86bb-e607a1d1524e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:40.752041 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107078c-50d0-422f-86bb-e607a1d1524e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:40.755884 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305673e-b4e9-42d4-8204-ac51711e2ee2 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-3107078c-50d0-422f-86bb-e607a1d1524e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:40.763517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:40.764468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:40.765375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:40.765375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:40.765375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:40.765375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:40.765375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:40.765375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:40.765375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:40.765375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:40.769317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 375/732] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:40.770745 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107078c-50d0-422f-86bb-e607a1d1524e None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:40.793173 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13533770-167c-48be-bc7a-9fb12de946a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:40.793837 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13533770-167c-48be-bc7a-9fb12de946a0 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.794128 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13533770-167c-48be-bc7a-9fb12de946a0 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.794390 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13533770-167c-48be-bc7a-9fb12de946a0 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.795041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13533770-167c-48be-bc7a-9fb12de946a0 None admin] RBAC: Adding query filter params (type=image) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:40.795302 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13533770-167c-48be-bc7a-9fb12de946a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:40.796679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13533770-167c-48be-bc7a-9fb12de946a0 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:40.801391 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 358/733] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:40.802213 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13533770-167c-48be-bc7a-9fb12de946a0 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:40.842800 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:40.876028 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107078c-50d0-422f-86bb-e607a1d1524e None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:40.901863 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13533770-167c-48be-bc7a-9fb12de946a0 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:40.909569 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea914e-69f2-4c69-9e73-966676e29b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:40.910203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea914e-69f2-4c69-9e73-966676e29b94 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.910479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea914e-69f2-4c69-9e73-966676e29b94 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.910766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea914e-69f2-4c69-9e73-966676e29b94 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.911376 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea914e-69f2-4c69-9e73-966676e29b94 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:40.911661 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea914e-69f2-4c69-9e73-966676e29b94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:40.913033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea914e-69f2-4c69-9e73-966676e29b94 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:40.917959 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 376/734] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 19:24:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:40.918789 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea914e-69f2-4c69-9e73-966676e29b94 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:40.936891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d0438-845d-4059-9cb7-8078460895ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:40.937510 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d0438-845d-4059-9cb7-8078460895ca None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:40.937798 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d0438-845d-4059-9cb7-8078460895ca None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:40.938089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d0438-845d-4059-9cb7-8078460895ca None admin] PATH_INFO: `/v3/services/network` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:40.938665 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d0438-845d-4059-9cb7-8078460895ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:40.940028 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d0438-845d-4059-9cb7-8078460895ca None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-384d0438-845d-4059-9cb7-8078460895ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:40.948876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:40.950287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:40.951459 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 359/735] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:40 2022] GET /identity/v3/services/network => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:40.952544 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d0438-845d-4059-9cb7-8078460895ca None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:40.955926 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:41.023492 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea914e-69f2-4c69-9e73-966676e29b94 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:41.052851 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:41.054643 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d0438-845d-4059-9cb7-8078460895ca None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:41.058538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dec7d6-8a85-4f34-a2d0-8fc7ac9c65be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:41.059143 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dec7d6-8a85-4f34-a2d0-8fc7ac9c65be None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:41.059455 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dec7d6-8a85-4f34-a2d0-8fc7ac9c65be None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:41.059726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dec7d6-8a85-4f34-a2d0-8fc7ac9c65be None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:41.060405 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dec7d6-8a85-4f34-a2d0-8fc7ac9c65be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:41.060702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dec7d6-8a85-4f34-a2d0-8fc7ac9c65be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:41.062167 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dec7d6-8a85-4f34-a2d0-8fc7ac9c65be None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:41.073927 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 377/736] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:41.074776 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dec7d6-8a85-4f34-a2d0-8fc7ac9c65be None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:41.094437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce555a8-07d8-439e-8f45-77da08b1a99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:41.095045 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce555a8-07d8-439e-8f45-77da08b1a99e None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:41.095323 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce555a8-07d8-439e-8f45-77da08b1a99e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:41.095595 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce555a8-07d8-439e-8f45-77da08b1a99e None admin] PATH_INFO: `/v3/endpoints` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:41.096266 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce555a8-07d8-439e-8f45-77da08b1a99e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:41.097657 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce555a8-07d8-439e-8f45-77da08b1a99e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:41.120293 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 360/737] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:24:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:41.121463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce555a8-07d8-439e-8f45-77da08b1a99e None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:41.197039 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dec7d6-8a85-4f34-a2d0-8fc7ac9c65be None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:41.197303 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:41.255586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce555a8-07d8-439e-8f45-77da08b1a99e None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:41.257467 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cf603-ab64-41af-a543-675ec65786a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:41.258128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cf603-ab64-41af-a543-675ec65786a4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:41.258403 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cf603-ab64-41af-a543-675ec65786a4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:41.258669 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cf603-ab64-41af-a543-675ec65786a4 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:41.259298 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cf603-ab64-41af-a543-675ec65786a4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:41.259596 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cf603-ab64-41af-a543-675ec65786a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:41.261017 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cf603-ab64-41af-a543-675ec65786a4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:41.271906 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 378/738] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 19:24:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:41.271906 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cf603-ab64-41af-a543-675ec65786a4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:41.297566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb674ef-a3bb-45ea-919b-800eb9dc6c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:41.298229 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb674ef-a3bb-45ea-919b-800eb9dc6c24 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:41.298501 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb674ef-a3bb-45ea-919b-800eb9dc6c24 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:41.298812 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb674ef-a3bb-45ea-919b-800eb9dc6c24 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:41.299470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb674ef-a3bb-45ea-919b-800eb9dc6c24 None admin] RBAC: Adding query filter params (name=network) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:41.299752 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb674ef-a3bb-45ea-919b-800eb9dc6c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:41.301136 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb674ef-a3bb-45ea-919b-800eb9dc6c24 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:41.307514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 361/739] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:24:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:41.307514 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb674ef-a3bb-45ea-919b-800eb9dc6c24 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:41.336414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:41.389396 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cf603-ab64-41af-a543-675ec65786a4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:41.416804 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb674ef-a3bb-45ea-919b-800eb9dc6c24 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:41.424644 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40474a-acfa-49fb-a24c-d309ca9d7357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:41.426857 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40474a-acfa-49fb-a24c-d309ca9d7357 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:41.426857 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40474a-acfa-49fb-a24c-d309ca9d7357 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:41.426857 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40474a-acfa-49fb-a24c-d309ca9d7357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:41.426857 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40474a-acfa-49fb-a24c-d309ca9d7357 None admin] RBAC: Adding query filter params (role.id=4ef4b944934e44a28a394ebd1a816f64, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=ff0c7740e6814c6c9515d0aed78bba68) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:41.427234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40474a-acfa-49fb-a24c-d309ca9d7357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:41.428394 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40474a-acfa-49fb-a24c-d309ca9d7357 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:41.442022 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 379/740] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:24:41 2022] GET /identity/v3/role_assignments?user.id=ff0c7740e6814c6c9515d0aed78bba68&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:41.442022 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40474a-acfa-49fb-a24c-d309ca9d7357 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:41.449306 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:41.477746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884a410-6134-463e-9ad5-5f0f28e00c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:41.478532 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a410-6134-463e-9ad5-5f0f28e00c11 None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:41.478890 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a410-6134-463e-9ad5-5f0f28e00c11 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:41.479450 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a410-6134-463e-9ad5-5f0f28e00c11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:41.480748 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884a410-6134-463e-9ad5-5f0f28e00c11 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:41.483743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884a410-6134-463e-9ad5-5f0f28e00c11 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:41.515717 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 362/741] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:24:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:41.588347 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40474a-acfa-49fb-a24c-d309ca9d7357 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:41.611499 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:41.643332 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cdab6-304a-4281-9361-8b3db1f5726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:41.644188 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cdab6-304a-4281-9361-8b3db1f5726e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:41.644561 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cdab6-304a-4281-9361-8b3db1f5726e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:41.644958 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cdab6-304a-4281-9361-8b3db1f5726e None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:41.645691 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cdab6-304a-4281-9361-8b3db1f5726e None admin] RBAC: Adding query filter params (type=network) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:41.646176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cdab6-304a-4281-9361-8b3db1f5726e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:41.647807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cdab6-304a-4281-9361-8b3db1f5726e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:41.655032 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 380/742] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:24:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:41.661391 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884a410-6134-463e-9ad5-5f0f28e00c11 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:41.781286 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884a410-6134-463e-9ad5-5f0f28e00c11 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:41.822274 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3221e-edea-49b8-bab7-20cb8e56bf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:41.822883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3221e-edea-49b8-bab7-20cb8e56bf50 None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:41.823159 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3221e-edea-49b8-bab7-20cb8e56bf50 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:41.823426 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3221e-edea-49b8-bab7-20cb8e56bf50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:41.824094 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3221e-edea-49b8-bab7-20cb8e56bf50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:41.825655 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3221e-edea-49b8-bab7-20cb8e56bf50 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:41.848858 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 363/743] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:24:41 2022] POST /identity/v3/endpoints => generated 337 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:43.376393 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac15a4-65c1-4ff1-9dc1-0d2b53d171de None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:43.376941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac15a4-65c1-4ff1-9dc1-0d2b53d171de None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:43.376941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac15a4-65c1-4ff1-9dc1-0d2b53d171de None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:43.378261 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 381/744] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:43.383802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0044-f242-447f-9fd0-5e127f0cdf2a None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:43.384244 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0044-f242-447f-9fd0-5e127f0cdf2a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:43.384336 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0044-f242-447f-9fd0-5e127f0cdf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:43.402769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-005b0044-f242-447f-9fd0-5e127f0cdf2a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:43.404283 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-005b0044-f242-447f-9fd0-5e127f0cdf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:43.433053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:43.485408 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 364/745] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:43 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:43.781130 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab7668-beab-4a21-95c5-8aa8c4d4094d None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:43.781528 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab7668-beab-4a21-95c5-8aa8c4d4094d None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:43.781629 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab7668-beab-4a21-95c5-8aa8c4d4094d None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:43.783204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 382/746] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:43.788297 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafec2d-e505-4071-8955-9011f88acb10 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:43.788544 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafec2d-e505-4071-8955-9011f88acb10 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:43.788855 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafec2d-e505-4071-8955-9011f88acb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:43.807467 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-4eafec2d-e505-4071-8955-9011f88acb10 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:43.808645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-4eafec2d-e505-4071-8955-9011f88acb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:43.811825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab7668-beab-4a21-95c5-8aa8c4d4094d None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:43.879650 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 365/747] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:43 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:43.880977 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1e439-0854-47e3-8640-e135b7660b1b None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:43.881261 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1e439-0854-47e3-8640-e135b7660b1b None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:43.881532 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1e439-0854-47e3-8640-e135b7660b1b None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:43.882846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 366/748] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:43.888937 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6d9e4-d98e-4949-acf3-5b2c78e65925 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:43.889219 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6d9e4-d98e-4949-acf3-5b2c78e65925 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:43.889490 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6d9e4-d98e-4949-acf3-5b2c78e65925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:43.908221 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-20f6d9e4-d98e-4949-acf3-5b2c78e65925 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:43.909407 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-20f6d9e4-d98e-4949-acf3-5b2c78e65925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:43.930480 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab7668-beab-4a21-95c5-8aa8c4d4094d None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:43.969340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca008b-797b-4fc8-a759-ebc5efe6f0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:43.969949 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca008b-797b-4fc8-a759-ebc5efe6f0f6 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:43.970589 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca008b-797b-4fc8-a759-ebc5efe6f0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:43.970589 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca008b-797b-4fc8-a759-ebc5efe6f0f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:43.985549 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 367/749] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:43 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:44.020736 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:44.047259 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca008b-797b-4fc8-a759-ebc5efe6f0f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:44.048710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca008b-797b-4fc8-a759-ebc5efe6f0f6 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:44.154056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 383/750] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:24:43 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 19:24:44.157109 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6d9e4-d98e-4949-acf3-5b2c78e65925 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:44.178070 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:44.198752 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca008b-797b-4fc8-a759-ebc5efe6f0f6 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:44.270007 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6d9e4-d98e-4949-acf3-5b2c78e65925 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:44.280215 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:44.306368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca008b-797b-4fc8-a759-ebc5efe6f0f6 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:44.307341 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea2f36-dcde-4e6e-bf0a-491f2cc5c02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:44.307979 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea2f36-dcde-4e6e-bf0a-491f2cc5c02f None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:44.308251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea2f36-dcde-4e6e-bf0a-491f2cc5c02f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:44.308577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea2f36-dcde-4e6e-bf0a-491f2cc5c02f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:44.318841 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea2f36-dcde-4e6e-bf0a-491f2cc5c02f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:44.320302 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea2f36-dcde-4e6e-bf0a-491f2cc5c02f None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-51ea2f36-dcde-4e6e-bf0a-491f2cc5c02f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:24:44.334891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:44.335930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:24:44.336821 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:24:44.336821 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:24:44.336821 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:44.336821 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 368/751] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:44.337224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea2f36-dcde-4e6e-bf0a-491f2cc5c02f None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:44.344844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c9529-d235-4833-8294-0175a5d516bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:44.345604 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c9529-d235-4833-8294-0175a5d516bc None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:44.345919 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c9529-d235-4833-8294-0175a5d516bc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:44.346216 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c9529-d235-4833-8294-0175a5d516bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:44.346792 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c9529-d235-4833-8294-0175a5d516bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:44.348158 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c9529-d235-4833-8294-0175a5d516bc None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-951c9529-d235-4833-8294-0175a5d516bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:44.357082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:44.358043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:24:44.358941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:44.359682 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 384/752] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Aug 19 19:24:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:44.360224 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c9529-d235-4833-8294-0175a5d516bc None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:44.405405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:44.440361 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea2f36-dcde-4e6e-bf0a-491f2cc5c02f None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:44.468362 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c9529-d235-4833-8294-0175a5d516bc None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:44.482465 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ab5ec-f7a1-44b5-8b58-c5c72f421bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:44.483257 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ab5ec-f7a1-44b5-8b58-c5c72f421bd7 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:44.483527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ab5ec-f7a1-44b5-8b58-c5c72f421bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:44.483835 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ab5ec-f7a1-44b5-8b58-c5c72f421bd7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:44.484390 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ab5ec-f7a1-44b5-8b58-c5c72f421bd7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:44.485756 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ab5ec-f7a1-44b5-8b58-c5c72f421bd7 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-e29ab5ec-f7a1-44b5-8b58-c5c72f421bd7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:44.494480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:44.495580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:44.496417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 369/753] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:24:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:44.497340 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ab5ec-f7a1-44b5-8b58-c5c72f421bd7 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:44.507133 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30ba67-300e-406a-be82-ad716d83e999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:44.507740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30ba67-300e-406a-be82-ad716d83e999 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:44.508014 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30ba67-300e-406a-be82-ad716d83e999 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:44.508283 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30ba67-300e-406a-be82-ad716d83e999 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:44.508934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30ba67-300e-406a-be82-ad716d83e999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:44.509231 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30ba67-300e-406a-be82-ad716d83e999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:44.510712 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30ba67-300e-406a-be82-ad716d83e999 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:44.520126 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:44.523782 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 385/754] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:44.524558 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30ba67-300e-406a-be82-ad716d83e999 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:44.627677 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ab5ec-f7a1-44b5-8b58-c5c72f421bd7 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:44.642709 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30ba67-300e-406a-be82-ad716d83e999 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:44.668834 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a39c9-787a-4f4d-a6a9-d24bab1016a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:44.669658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a39c9-787a-4f4d-a6a9-d24bab1016a4 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:44.669897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a39c9-787a-4f4d-a6a9-d24bab1016a4 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:44.670267 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a39c9-787a-4f4d-a6a9-d24bab1016a4 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:44.670932 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a39c9-787a-4f4d-a6a9-d24bab1016a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:44.671238 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a39c9-787a-4f4d-a6a9-d24bab1016a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:44.672636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a39c9-787a-4f4d-a6a9-d24bab1016a4 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:44.674666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:44.682511 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 370/755] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 19:24:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:44.685148 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a39c9-787a-4f4d-a6a9-d24bab1016a4 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:44.688841 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dcf87-6533-44c7-891a-4254bab99c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:44.689486 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dcf87-6533-44c7-891a-4254bab99c72 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:44.689730 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dcf87-6533-44c7-891a-4254bab99c72 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:44.690021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dcf87-6533-44c7-891a-4254bab99c72 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:44.690702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dcf87-6533-44c7-891a-4254bab99c72 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:44.691008 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dcf87-6533-44c7-891a-4254bab99c72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:44.692431 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dcf87-6533-44c7-891a-4254bab99c72 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:44.698035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 386/756] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:24:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:44.703929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dcf87-6533-44c7-891a-4254bab99c72 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:44.780577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:44.809763 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a39c9-787a-4f4d-a6a9-d24bab1016a4 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:44.827813 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dcf87-6533-44c7-891a-4254bab99c72 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:44.852736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434a1ec-e05a-415f-a671-8f2f3b82dfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:44.853348 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a1ec-e05a-415f-a671-8f2f3b82dfc7 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:44.853608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a1ec-e05a-415f-a671-8f2f3b82dfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:44.853868 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a1ec-e05a-415f-a671-8f2f3b82dfc7 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:44.854537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434a1ec-e05a-415f-a671-8f2f3b82dfc7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:44.854832 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434a1ec-e05a-415f-a671-8f2f3b82dfc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:44.856222 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434a1ec-e05a-415f-a671-8f2f3b82dfc7 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:44.860825 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 371/757] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 19:24:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:44.865591 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8350f0-af90-435b-aed5-2d2527a8d655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:44.866243 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8350f0-af90-435b-aed5-2d2527a8d655 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:44.866520 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8350f0-af90-435b-aed5-2d2527a8d655 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:44.866789 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8350f0-af90-435b-aed5-2d2527a8d655 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:44.867425 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8350f0-af90-435b-aed5-2d2527a8d655 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:44.867727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8350f0-af90-435b-aed5-2d2527a8d655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:44.869143 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8350f0-af90-435b-aed5-2d2527a8d655 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:44.875040 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 387/758] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:24:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:47.011111 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a706-63d8-460b-946f-d976a7020996 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:47.011674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a706-63d8-460b-946f-d976a7020996 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:47.011674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a706-63d8-460b-946f-d976a7020996 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:47.013356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 372/759] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:47.018580 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7ef27-2037-4a15-bfc2-acb97602ecc2 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:47.019006 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7ef27-2037-4a15-bfc2-acb97602ecc2 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:47.019236 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7ef27-2037-4a15-bfc2-acb97602ecc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:47.038237 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-92b7ef27-2037-4a15-bfc2-acb97602ecc2 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:47.039420 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-92b7ef27-2037-4a15-bfc2-acb97602ecc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:47.050099 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8e57-6957-4710-b65b-719812d11b5d None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:47.050381 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8e57-6957-4710-b65b-719812d11b5d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:47.050650 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8e57-6957-4710-b65b-719812d11b5d None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:47.051968 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 373/760] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:24:47.056712 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3765-829c-4d37-9831-c0eace7af2c5 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:47.056988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3765-829c-4d37-9831-c0eace7af2c5 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:47.057259 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3765-829c-4d37-9831-c0eace7af2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:47.075431 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-ceab3765-829c-4d37-9831-c0eace7af2c5 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:47.076618 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-ceab3765-829c-4d37-9831-c0eace7af2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:47.111033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 388/761] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:47 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:47.136359 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:47.147030 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 374/762] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:47 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:24:47.449940 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7ef27-2037-4a15-bfc2-acb97602ecc2 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:47.469886 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab3765-829c-4d37-9831-c0eace7af2c5 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:47.513614 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:47.556897 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7ef27-2037-4a15-bfc2-acb97602ecc2 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:47.574026 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab3765-829c-4d37-9831-c0eace7af2c5 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:47.591973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea539d76-bc38-46be-9ce6-db7b95ecd730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:47.592576 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea539d76-bc38-46be-9ce6-db7b95ecd730 None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:47.592849 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea539d76-bc38-46be-9ce6-db7b95ecd730 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:47.593114 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea539d76-bc38-46be-9ce6-db7b95ecd730 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:47.593729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea539d76-bc38-46be-9ce6-db7b95ecd730 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:47.595131 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea539d76-bc38-46be-9ce6-db7b95ecd730 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:47.608896 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285af5d-336e-4d18-b5e1-74170e91d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:47.609499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285af5d-336e-4d18-b5e1-74170e91d75e None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:47.609774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285af5d-336e-4d18-b5e1-74170e91d75e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:47.610072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285af5d-336e-4d18-b5e1-74170e91d75e None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:47.610334 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 389/763] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 19:24:47 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:47.614119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285af5d-336e-4d18-b5e1-74170e91d75e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:47.614119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285af5d-336e-4d18-b5e1-74170e91d75e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:47.629545 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 375/764] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 19:24:47 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:24:49.824685 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7b3dd-a206-4668-8bd6-bad49d177eb7 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:49.825406 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7b3dd-a206-4668-8bd6-bad49d177eb7 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:49.825406 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7b3dd-a206-4668-8bd6-bad49d177eb7 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:49.826582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 390/765] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:49.826732 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cd2c8-ba6c-405f-bf88-969ee0cdebea None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:49.827136 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cd2c8-ba6c-405f-bf88-969ee0cdebea None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:49.827269 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cd2c8-ba6c-405f-bf88-969ee0cdebea None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:49.831749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ec316-ac48-4b1d-a995-d9270ddbe591 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:49.832031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ec316-ac48-4b1d-a995-d9270ddbe591 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:49.832307 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ec316-ac48-4b1d-a995-d9270ddbe591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:49.832557 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 376/766] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:24:49.838111 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297ccc9-33c2-449e-84e3-9e1b2975c1dd None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:49.838390 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297ccc9-33c2-449e-84e3-9e1b2975c1dd None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:49.838660 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297ccc9-33c2-449e-84e3-9e1b2975c1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:49.853331 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-d41ec316-ac48-4b1d-a995-d9270ddbe591 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:49.854596 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-d41ec316-ac48-4b1d-a995-d9270ddbe591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:49.856522 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-4297ccc9-33c2-449e-84e3-9e1b2975c1dd None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:49.857526 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-4297ccc9-33c2-449e-84e3-9e1b2975c1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:49.906648 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:49.934457 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 377/767] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:49 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:24:49.936826 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 391/768] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:49 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:50.260332 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297ccc9-33c2-449e-84e3-9e1b2975c1dd None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:50.260578 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ec316-ac48-4b1d-a995-d9270ddbe591 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:50.310575 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:50.365819 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297ccc9-33c2-449e-84e3-9e1b2975c1dd None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:50.366511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ec316-ac48-4b1d-a995-d9270ddbe591 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:50.398566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9d0b9-f894-43c0-a3d7-c5974e25ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:50.399022 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc92515-bc44-4522-9844-615683d254b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:50.399206 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9d0b9-f894-43c0-a3d7-c5974e25ed24 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:50.399480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9d0b9-f894-43c0-a3d7-c5974e25ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:50.399655 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc92515-bc44-4522-9844-615683d254b0 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:50.399755 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9d0b9-f894-43c0-a3d7-c5974e25ed24 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:50.399930 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc92515-bc44-4522-9844-615683d254b0 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:50.400196 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc92515-bc44-4522-9844-615683d254b0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:50.400292 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9d0b9-f894-43c0-a3d7-c5974e25ed24 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:50.400772 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc92515-bc44-4522-9844-615683d254b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:50.401668 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9d0b9-f894-43c0-a3d7-c5974e25ed24 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:50.402185 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc92515-bc44-4522-9844-615683d254b0 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-59d9d0b9-f894-43c0-a3d7-c5974e25ed24 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:50.410666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:50.411969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:24:50.412897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-7cc92515-bc44-4522-9844-615683d254b0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:50.413695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:50.414616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:24:50.415860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:50.416591 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 378/769] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:24:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:50.417176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 392/770] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Aug 19 19:24:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:50.418043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9d0b9-f894-43c0-a3d7-c5974e25ed24 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:50.418870 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc92515-bc44-4522-9844-615683d254b0 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:50.464253 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:50.519549 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc92515-bc44-4522-9844-615683d254b0 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:50.522860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9d0b9-f894-43c0-a3d7-c5974e25ed24 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:50.528529 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:50.555408 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135701-e496-4a94-867b-1d68267d68fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:50.556016 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135701-e496-4a94-867b-1d68267d68fb None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:50.556283 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135701-e496-4a94-867b-1d68267d68fb None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:50.556544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135701-e496-4a94-867b-1d68267d68fb None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:50.557161 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135701-e496-4a94-867b-1d68267d68fb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:50.557453 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135701-e496-4a94-867b-1d68267d68fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:50.558008 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b8062-e6c5-4033-b0a5-63bf89d242cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:50.558632 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8062-e6c5-4033-b0a5-63bf89d242cd None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:50.558867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135701-e496-4a94-867b-1d68267d68fb None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:50.559001 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8062-e6c5-4033-b0a5-63bf89d242cd None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:50.559130 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8062-e6c5-4033-b0a5-63bf89d242cd None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:50.559796 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8062-e6c5-4033-b0a5-63bf89d242cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:50.560089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8062-e6c5-4033-b0a5-63bf89d242cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:50.561431 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8062-e6c5-4033-b0a5-63bf89d242cd None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:50.563787 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 393/771] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 19:24:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:50.566405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 379/772] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:24:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:50.569506 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135701-e496-4a94-867b-1d68267d68fb None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:50.571558 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b8062-e6c5-4033-b0a5-63bf89d242cd None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:50.669421 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135701-e496-4a94-867b-1d68267d68fb None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:50.674826 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b8062-e6c5-4033-b0a5-63bf89d242cd None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:50.681680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:50.705081 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144c6a4-7172-474b-b0c8-503d7a6421bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:50.705707 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144c6a4-7172-474b-b0c8-503d7a6421bd None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:50.705982 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144c6a4-7172-474b-b0c8-503d7a6421bd None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:50.706283 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144c6a4-7172-474b-b0c8-503d7a6421bd None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:50.706898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144c6a4-7172-474b-b0c8-503d7a6421bd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:50.707185 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144c6a4-7172-474b-b0c8-503d7a6421bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:50.708557 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144c6a4-7172-474b-b0c8-503d7a6421bd None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:50.708667 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c0624-f824-456b-93f1-45b05f596bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:50.709265 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c0624-f824-456b-93f1-45b05f596bc6 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:50.709644 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c0624-f824-456b-93f1-45b05f596bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:50.709805 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c0624-f824-456b-93f1-45b05f596bc6 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:50.710609 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c0624-f824-456b-93f1-45b05f596bc6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:50.710911 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c0624-f824-456b-93f1-45b05f596bc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:50.712259 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c0624-f824-456b-93f1-45b05f596bc6 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:50.713600 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 394/773] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 19:24:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:50.717266 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 380/774] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:24:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:50.720444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144c6a4-7172-474b-b0c8-503d7a6421bd None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:50.723212 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c0624-f824-456b-93f1-45b05f596bc6 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:50.756113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:50.821254 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144c6a4-7172-474b-b0c8-503d7a6421bd None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:50.821870 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c0624-f824-456b-93f1-45b05f596bc6 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:50.855820 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36365f-06a7-41a6-a563-5f2259274557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:50.856541 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980640-b2e5-4d95-a95d-f8a5bebddd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:50.856919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36365f-06a7-41a6-a563-5f2259274557 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:50.857012 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980640-b2e5-4d95-a95d-f8a5bebddd79 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:50.857115 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36365f-06a7-41a6-a563-5f2259274557 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:50.857207 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980640-b2e5-4d95-a95d-f8a5bebddd79 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:50.857297 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36365f-06a7-41a6-a563-5f2259274557 None admin] PATH_INFO: `/v3/endpoints` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:50.857390 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980640-b2e5-4d95-a95d-f8a5bebddd79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:50.857622 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36365f-06a7-41a6-a563-5f2259274557 None admin] RBAC: Adding query filter params (interface=public, service_id=7f8b6fde0f63408a85215ab2a0d097a8, region_id=RegionOne) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:50.857880 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0980640-b2e5-4d95-a95d-f8a5bebddd79 None admin] RBAC: Adding query filter params (interface=public, service_id=25cc698538c946468f0e6f231da48d00, region_id=RegionOne) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:50.857972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36365f-06a7-41a6-a563-5f2259274557 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:50.858222 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0980640-b2e5-4d95-a95d-f8a5bebddd79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:50.859305 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36365f-06a7-41a6-a563-5f2259274557 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:50.859588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0980640-b2e5-4d95-a95d-f8a5bebddd79 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:50.864283 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 381/775] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 19:24:50 2022] GET /identity/v3/endpoints?service_id=7f8b6fde0f63408a85215ab2a0d097a8&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:50.864622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 395/776] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 19:24:50 2022] GET /identity/v3/endpoints?service_id=25cc698538c946468f0e6f231da48d00&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:50.870246 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36365f-06a7-41a6-a563-5f2259274557 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:50.871435 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980640-b2e5-4d95-a95d-f8a5bebddd79 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:50.903688 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:50.971866 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36365f-06a7-41a6-a563-5f2259274557 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:50.973444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:50.976457 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980640-b2e5-4d95-a95d-f8a5bebddd79 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:51.007867 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602c50c-8c14-49a4-a9a5-e814085319ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:51.008477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602c50c-8c14-49a4-a9a5-e814085319ce None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:51.008754 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602c50c-8c14-49a4-a9a5-e814085319ce None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:51.009024 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602c50c-8c14-49a4-a9a5-e814085319ce None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:51.009624 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602c50c-8c14-49a4-a9a5-e814085319ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:51.010822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a328a3-8fbb-4063-8734-84941eb7827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:51.011033 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602c50c-8c14-49a4-a9a5-e814085319ce None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:51.011428 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a328a3-8fbb-4063-8734-84941eb7827c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:51.011702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a328a3-8fbb-4063-8734-84941eb7827c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:51.012065 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a328a3-8fbb-4063-8734-84941eb7827c None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:51.013149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a328a3-8fbb-4063-8734-84941eb7827c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:51.014551 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a328a3-8fbb-4063-8734-84941eb7827c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:51.016972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 382/777] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 19:24:50 2022] GET /identity/v3/services => generated 1498 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:24:51.020444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 396/778] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 19:24:50 2022] GET /identity/v3/services => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:24:53.209319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a3837-d38f-49ab-b50a-181584279c8e None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:53.209871 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a3837-d38f-49ab-b50a-181584279c8e None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:53.209871 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a3837-d38f-49ab-b50a-181584279c8e None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:53.211219 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 383/779] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:53.217367 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd820060-d3b2-463b-9659-23269d461fa0 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:53.217852 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd820060-d3b2-463b-9659-23269d461fa0 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:53.217954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd820060-d3b2-463b-9659-23269d461fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:53.233024 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf5e8-6e8b-420f-8c36-c73ca876b5b4 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:53.233272 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf5e8-6e8b-420f-8c36-c73ca876b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:53.233591 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf5e8-6e8b-420f-8c36-c73ca876b5b4 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:53.234947 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 384/780] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:24:53.237422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-bd820060-d3b2-463b-9659-23269d461fa0 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:53.239441 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-bd820060-d3b2-463b-9659-23269d461fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:53.241891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17b87f-df4a-4bc8-ab2f-6cfeb8b9157d None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:53.242212 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17b87f-df4a-4bc8-ab2f-6cfeb8b9157d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:53.242476 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17b87f-df4a-4bc8-ab2f-6cfeb8b9157d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:53.261697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-2b17b87f-df4a-4bc8-ab2f-6cfeb8b9157d None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:53.263553 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-2b17b87f-df4a-4bc8-ab2f-6cfeb8b9157d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:53.310845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 397/781] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:53 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:53.332596 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 385/782] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:53 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:53.633380 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd820060-d3b2-463b-9659-23269d461fa0 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:53.658215 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17b87f-df4a-4bc8-ab2f-6cfeb8b9157d None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:53.687090 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:53.736322 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:53.743708 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd820060-d3b2-463b-9659-23269d461fa0 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:53.760147 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17b87f-df4a-4bc8-ab2f-6cfeb8b9157d None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:53.777891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718c192-9ed6-403a-b45a-3ea2db83ce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:53.778585 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718c192-9ed6-403a-b45a-3ea2db83ce9a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:53.778865 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718c192-9ed6-403a-b45a-3ea2db83ce9a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:53.779136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718c192-9ed6-403a-b45a-3ea2db83ce9a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:53.779717 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718c192-9ed6-403a-b45a-3ea2db83ce9a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:53.781102 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718c192-9ed6-403a-b45a-3ea2db83ce9a None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-0718c192-9ed6-403a-b45a-3ea2db83ce9a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:53.789680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:53.791276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:53.792345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 398/783] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Aug 19 19:24:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:53.797029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1f36-b243-4ba2-904a-51d548fbf06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:53.797204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718c192-9ed6-403a-b45a-3ea2db83ce9a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:53.797659 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1f36-b243-4ba2-904a-51d548fbf06d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:53.797936 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1f36-b243-4ba2-904a-51d548fbf06d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:53.798248 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1f36-b243-4ba2-904a-51d548fbf06d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:53.798826 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db1f36-b243-4ba2-904a-51d548fbf06d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:53.800185 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db1f36-b243-4ba2-904a-51d548fbf06d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-60db1f36-b243-4ba2-904a-51d548fbf06d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:53.808895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:53.809916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:53.811017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 386/784] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:24:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:53.816327 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1f36-b243-4ba2-904a-51d548fbf06d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:53.900044 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718c192-9ed6-403a-b45a-3ea2db83ce9a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:53.909373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:53.918913 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1f36-b243-4ba2-904a-51d548fbf06d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:53.934515 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1c872-0f35-4008-9bed-25c1ccbf8d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:53.935147 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1c872-0f35-4008-9bed-25c1ccbf8d80 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:53.935418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1c872-0f35-4008-9bed-25c1ccbf8d80 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:53.935679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1c872-0f35-4008-9bed-25c1ccbf8d80 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:53.936292 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1c872-0f35-4008-9bed-25c1ccbf8d80 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:53.936583 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1c872-0f35-4008-9bed-25c1ccbf8d80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:53.937943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1c872-0f35-4008-9bed-25c1ccbf8d80 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:53.942603 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 399/785] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 19:24:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:53.948411 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1c872-0f35-4008-9bed-25c1ccbf8d80 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:53.952727 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53328415-6e9a-45d5-8fae-f9168dbf34fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:53.953336 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53328415-6e9a-45d5-8fae-f9168dbf34fc None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:53.953611 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53328415-6e9a-45d5-8fae-f9168dbf34fc None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:53.953881 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53328415-6e9a-45d5-8fae-f9168dbf34fc None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:53.954540 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53328415-6e9a-45d5-8fae-f9168dbf34fc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:53.954840 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53328415-6e9a-45d5-8fae-f9168dbf34fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:53.956199 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53328415-6e9a-45d5-8fae-f9168dbf34fc None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:53.961284 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 387/786] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:24:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:53.967319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53328415-6e9a-45d5-8fae-f9168dbf34fc None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:53.972921 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:54.050220 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1c872-0f35-4008-9bed-25c1ccbf8d80 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:54.064760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53328415-6e9a-45d5-8fae-f9168dbf34fc None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:54.084010 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a127c-ae60-4741-a443-718ed28af4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:54.084589 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a127c-ae60-4741-a443-718ed28af4f4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:54.084868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a127c-ae60-4741-a443-718ed28af4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:54.085136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a127c-ae60-4741-a443-718ed28af4f4 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:54.085765 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a127c-ae60-4741-a443-718ed28af4f4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:54.086096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a127c-ae60-4741-a443-718ed28af4f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:54.087479 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a127c-ae60-4741-a443-718ed28af4f4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:54.092630 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 400/787] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 19:24:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:54.098369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aab33-328b-4ed8-a5b9-0efaa45d2d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:54.098522 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a127c-ae60-4741-a443-718ed28af4f4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:54.098975 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aab33-328b-4ed8-a5b9-0efaa45d2d5a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:54.099252 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aab33-328b-4ed8-a5b9-0efaa45d2d5a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:54.099518 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aab33-328b-4ed8-a5b9-0efaa45d2d5a None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:54.100139 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1aab33-328b-4ed8-a5b9-0efaa45d2d5a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:54.100437 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1aab33-328b-4ed8-a5b9-0efaa45d2d5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:54.101817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1aab33-328b-4ed8-a5b9-0efaa45d2d5a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:54.106756 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 388/788] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 19:24:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:54.112629 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aab33-328b-4ed8-a5b9-0efaa45d2d5a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:54.135085 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:54.188825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:54.204473 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a127c-ae60-4741-a443-718ed28af4f4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:54.218761 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aab33-328b-4ed8-a5b9-0efaa45d2d5a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:54.239528 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2c955-e5a8-4e7e-8e28-0f525de3b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:54.240143 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c955-e5a8-4e7e-8e28-0f525de3b813 None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:54.240418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c955-e5a8-4e7e-8e28-0f525de3b813 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:54.240685 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c955-e5a8-4e7e-8e28-0f525de3b813 None admin] PATH_INFO: `/v3/endpoints` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:54.241357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2c955-e5a8-4e7e-8e28-0f525de3b813 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:54.242799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2c955-e5a8-4e7e-8e28-0f525de3b813 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:54.262469 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9cccc-f07d-4a0b-8de4-b19dcbfc1f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:54.263064 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9cccc-f07d-4a0b-8de4-b19dcbfc1f74 None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:54.263333 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9cccc-f07d-4a0b-8de4-b19dcbfc1f74 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:54.263595 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9cccc-f07d-4a0b-8de4-b19dcbfc1f74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:54.264343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9cccc-f07d-4a0b-8de4-b19dcbfc1f74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:54.265433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 401/789] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:24:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:54.270251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9cccc-f07d-4a0b-8de4-b19dcbfc1f74 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:54.318062 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 389/790] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:24:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:24:56.460309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b287bc-1f17-4f8b-8de0-dea7e508bf02 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:56.460843 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b287bc-1f17-4f8b-8de0-dea7e508bf02 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:56.460843 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b287bc-1f17-4f8b-8de0-dea7e508bf02 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:56.462124 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 402/791] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:56.467582 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c471-7b85-4e46-9fb4-cfc0123ca811 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:56.468029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c471-7b85-4e46-9fb4-cfc0123ca811 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:56.468177 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c471-7b85-4e46-9fb4-cfc0123ca811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:56.487852 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-3791c471-7b85-4e46-9fb4-cfc0123ca811 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:56.489050 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-3791c471-7b85-4e46-9fb4-cfc0123ca811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:56.509065 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58cc3-d804-42d8-a608-674a7a38324a None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:56.509352 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58cc3-d804-42d8-a608-674a7a38324a None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:56.509626 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58cc3-d804-42d8-a608-674a7a38324a None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:56.511327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 403/792] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:56.516520 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f184d74-148f-4259-9087-d02f6167ce86 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:56.516803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f184d74-148f-4259-9087-d02f6167ce86 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:56.517115 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f184d74-148f-4259-9087-d02f6167ce86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:56.536254 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-3f184d74-148f-4259-9087-d02f6167ce86 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:56.537478 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-3f184d74-148f-4259-9087-d02f6167ce86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:56.563803 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 390/793] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:56 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:56.606154 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 404/794] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:56 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:56.888408 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c471-7b85-4e46-9fb4-cfc0123ca811 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:56.890685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:56.932860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f184d74-148f-4259-9087-d02f6167ce86 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:56.992191 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c471-7b85-4e46-9fb4-cfc0123ca811 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:57.002256 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:57.026486 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aad60-e503-4d45-a50f-4abd00c5ebc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:57.027112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aad60-e503-4d45-a50f-4abd00c5ebc9 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:57.027416 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aad60-e503-4d45-a50f-4abd00c5ebc9 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:57.027689 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aad60-e503-4d45-a50f-4abd00c5ebc9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:57.028266 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8aad60-e503-4d45-a50f-4abd00c5ebc9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:57.029644 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8aad60-e503-4d45-a50f-4abd00c5ebc9 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:57.032651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f184d74-148f-4259-9087-d02f6167ce86 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-eb8aad60-e503-4d45-a50f-4abd00c5ebc9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:57.038334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:57.045108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:24:57.046043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 391/795] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:57.046852 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aad60-e503-4d45-a50f-4abd00c5ebc9 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:57.068454 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fff489-544c-4d67-af4c-9ac89c18a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:57.069054 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fff489-544c-4d67-af4c-9ac89c18a2f4 None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:57.069321 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fff489-544c-4d67-af4c-9ac89c18a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:57.069577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fff489-544c-4d67-af4c-9ac89c18a2f4 None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:57.070239 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fff489-544c-4d67-af4c-9ac89c18a2f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:57.071671 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fff489-544c-4d67-af4c-9ac89c18a2f4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:57.074298 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: WARNING keystone.server.flask.common [None req-43fff489-544c-4d67-af4c-9ac89c18a2f4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 19:24:57.091303 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.sql.core [None req-43fff489-544c-4d67-af4c-9ac89c18a2f4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 19:24:57.091303 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 19:24:57.091303 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [parameters: {'id': '7a051fb517a6471388c4a7850cbd5317', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 19:24:57.091303 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=123562) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-43fff489-544c-4d67-af4c-9ac89c18a2f4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7a051fb517a6471388c4a7850cbd5317.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7a051fb517a6471388c4a7850cbd5317. Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application conn.query(q) Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 19:24:57.107514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application result.read() Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 19:24:57.108348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application next(self.gen) Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application yield resource Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application next(self.gen) Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise self.value Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application session.commit() Aug 19 19:24:57.109348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self.session.flush() Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application compat.raise_( Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 19:24:57.110313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 19:24:57.111304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application conn.query(q) Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application result.read() Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 19:24:57.112149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [parameters: {'id': '7a051fb517a6471388c4a7850cbd5317', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:57.113056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:57.113869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:57.114825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:57.114825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 19:24:57.114825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 19:24:57.114825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:57.114825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:57.114825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 19:24:57.114825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 19:24:57.114825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7a051fb517a6471388c4a7850cbd5317. Aug 19 19:24:57.114825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:57.114825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 405/796] 10.222.0.60 () {60 vars in 1140 bytes} [Fri Aug 19 19:24:56 2022] POST /identity/v3/projects => generated 262 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:24:57.115438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fff489-544c-4d67-af4c-9ac89c18a2f4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:57.118298 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:57.154533 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aad60-e503-4d45-a50f-4abd00c5ebc9 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:57.189210 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5967d4-41ee-470d-ac9b-31e0e4278aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:57.189828 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5967d4-41ee-470d-ac9b-31e0e4278aba None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:57.190128 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5967d4-41ee-470d-ac9b-31e0e4278aba None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:57.190423 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5967d4-41ee-470d-ac9b-31e0e4278aba None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:57.191031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5967d4-41ee-470d-ac9b-31e0e4278aba None admin] RBAC: Adding query filter params (name=compute) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:57.191332 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5967d4-41ee-470d-ac9b-31e0e4278aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:57.192708 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5967d4-41ee-470d-ac9b-31e0e4278aba None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:57.198254 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 392/797] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:24:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:24:57.203865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5967d4-41ee-470d-ac9b-31e0e4278aba None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:57.220980 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fff489-544c-4d67-af4c-9ac89c18a2f4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:57.248773 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:57.258037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c544dfc-ec6b-448f-9690-65b069a6ff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:57.258686 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544dfc-ec6b-448f-9690-65b069a6ff62 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:57.258960 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544dfc-ec6b-448f-9690-65b069a6ff62 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:57.259227 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544dfc-ec6b-448f-9690-65b069a6ff62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:57.266463 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c544dfc-ec6b-448f-9690-65b069a6ff62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:57.268103 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c544dfc-ec6b-448f-9690-65b069a6ff62 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-0c544dfc-ec6b-448f-9690-65b069a6ff62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:24:57.279612 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:24:57.280519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:24:57.281696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:24:57.281696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:24:57.281696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:24:57.281696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:24:57.281696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:24:57.281696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:24:57.281696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:24:57.281696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:24:57.281696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 406/798] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:24:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:24:57.286585 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c544dfc-ec6b-448f-9690-65b069a6ff62 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:57.310305 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5967d4-41ee-470d-ac9b-31e0e4278aba None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:57.338971 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:57.345440 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054cd82-977b-4a74-b8f2-9df3768b911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:57.346066 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054cd82-977b-4a74-b8f2-9df3768b911a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:57.346336 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054cd82-977b-4a74-b8f2-9df3768b911a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:57.346605 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054cd82-977b-4a74-b8f2-9df3768b911a None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:57.347227 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054cd82-977b-4a74-b8f2-9df3768b911a None admin] RBAC: Adding query filter params (type=compute) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:57.347521 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054cd82-977b-4a74-b8f2-9df3768b911a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:57.348886 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054cd82-977b-4a74-b8f2-9df3768b911a None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:57.353607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 393/799] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:24:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:57.391732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c544dfc-ec6b-448f-9690-65b069a6ff62 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:57.435450 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dbeab-171d-42f6-a208-d833e041caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:57.436021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dbeab-171d-42f6-a208-d833e041caa4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:57.436294 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dbeab-171d-42f6-a208-d833e041caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:57.436553 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dbeab-171d-42f6-a208-d833e041caa4 None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:57.437223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dbeab-171d-42f6-a208-d833e041caa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:24:57.437518 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dbeab-171d-42f6-a208-d833e041caa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:57.439021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dbeab-171d-42f6-a208-d833e041caa4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:57.461443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 407/800] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:24:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:24:59.572098 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724d040-3cbc-4d71-aa90-9f3137bbe901 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:59.572693 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724d040-3cbc-4d71-aa90-9f3137bbe901 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:59.572693 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724d040-3cbc-4d71-aa90-9f3137bbe901 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:59.573933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 394/801] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:59.579651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee210e8-b47d-4bbb-a78d-bf1be7d38f46 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:59.580110 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee210e8-b47d-4bbb-a78d-bf1be7d38f46 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:59.580204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee210e8-b47d-4bbb-a78d-bf1be7d38f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:59.601795 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-9ee210e8-b47d-4bbb-a78d-bf1be7d38f46 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:59.603344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-9ee210e8-b47d-4bbb-a78d-bf1be7d38f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:59.649513 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:59.675411 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 408/802] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:59 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:24:59.677480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ab422-83a2-4c66-9153-3e8bc45dbfc6 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:59.677773 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ab422-83a2-4c66-9153-3e8bc45dbfc6 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:59.678041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ab422-83a2-4c66-9153-3e8bc45dbfc6 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:59.679383 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 395/803] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:59.684576 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea25ed-3842-4fcd-84ca-ae3acf6f5e3c None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:59.684862 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea25ed-3842-4fcd-84ca-ae3acf6f5e3c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:59.685127 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea25ed-3842-4fcd-84ca-ae3acf6f5e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:59.703674 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-d3ea25ed-3842-4fcd-84ca-ae3acf6f5e3c None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:59.705037 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-d3ea25ed-3842-4fcd-84ca-ae3acf6f5e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:59.774157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 409/804] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:59 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:25:00.001862 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ab422-83a2-4c66-9153-3e8bc45dbfc6 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:00.097462 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea25ed-3842-4fcd-84ca-ae3acf6f5e3c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:00.109785 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ab422-83a2-4c66-9153-3e8bc45dbfc6 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:00.146608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c75675-ce8e-4c60-842c-a2914bf0104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:00.147241 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c75675-ce8e-4c60-842c-a2914bf0104f None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:00.147482 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c75675-ce8e-4c60-842c-a2914bf0104f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:00.147770 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c75675-ce8e-4c60-842c-a2914bf0104f None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:00.148402 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c75675-ce8e-4c60-842c-a2914bf0104f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:00.149768 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c75675-ce8e-4c60-842c-a2914bf0104f None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:00.167397 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 396/805] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 19:25:00 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:25:00.209470 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea25ed-3842-4fcd-84ca-ae3acf6f5e3c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:00.220755 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:25:00.256291 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6109f9-ef16-4c15-9611-fb7db4a1f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:00.256822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6109f9-ef16-4c15-9611-fb7db4a1f8ee None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:00.257098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6109f9-ef16-4c15-9611-fb7db4a1f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:00.257367 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6109f9-ef16-4c15-9611-fb7db4a1f8ee None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:00.258017 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6109f9-ef16-4c15-9611-fb7db4a1f8ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:00.259486 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6109f9-ef16-4c15-9611-fb7db4a1f8ee None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:00.276882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.sql.core [None req-0a6109f9-ef16-4c15-9611-fb7db4a1f8ee None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 19:25:00.276882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 19:25:00.276882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [parameters: {'user_id': '21e32cf080be46cebdb4079bf865027c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 19:25:00.276882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=123562) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-0a6109f9-ef16-4c15-9611-fb7db4a1f8ee None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application conn.query(q) Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application result.read() Aug 19 19:25:00.284867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 19:25:00.285943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application next(self.gen) Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application yield resource Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application next(self.gen) Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise self.value Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application session.commit() Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 19:25:00.286944 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self.session.flush() Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application compat.raise_( Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 19:25:00.287868 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 19:25:00.288771 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application conn.query(q) Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application result.read() Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 19:25:00.289613 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [parameters: {'user_id': '21e32cf080be46cebdb4079bf865027c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:25:00.290887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 19:25:00.291679 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 19:25:00.292642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 19:25:00.292642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 19:25:00.292642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 19:25:00.292642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 19:25:00.292642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 19:25:00.292642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:25:00.292642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 410/806] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Aug 19 19:25:00 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:25:00.293325 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c75675-ce8e-4c60-842c-a2914bf0104f None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:00.360977 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:25:00.407787 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c75675-ce8e-4c60-842c-a2914bf0104f None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:00.440648 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729c114-79ea-409f-9812-5fed0e229ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:00.441269 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729c114-79ea-409f-9812-5fed0e229ffd None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:00.441538 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729c114-79ea-409f-9812-5fed0e229ffd None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:00.441800 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729c114-79ea-409f-9812-5fed0e229ffd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:00.450442 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729c114-79ea-409f-9812-5fed0e229ffd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:00.451889 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729c114-79ea-409f-9812-5fed0e229ffd None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-3729c114-79ea-409f-9812-5fed0e229ffd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:25:00.462965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:25:00.463946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:25:00.465312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:25:00.465312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:25:00.465312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:25:00.465312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:25:00.465312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:25:00.465312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:25:00.465312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:25:00.465312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:25:00.465312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:25:00.465312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:25:00.465312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 397/807] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:25:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:25:00.470275 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6109f9-ef16-4c15-9611-fb7db4a1f8ee None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:00.575746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6109f9-ef16-4c15-9611-fb7db4a1f8ee None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:00.610836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fada7-02fb-4bbc-ad60-2934ceaf06d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:00.611477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fada7-02fb-4bbc-ad60-2934ceaf06d7 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:00.611708 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fada7-02fb-4bbc-ad60-2934ceaf06d7 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:00.611978 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fada7-02fb-4bbc-ad60-2934ceaf06d7 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:00.612667 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fada7-02fb-4bbc-ad60-2934ceaf06d7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:25:00.612965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fada7-02fb-4bbc-ad60-2934ceaf06d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:00.614636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fada7-02fb-4bbc-ad60-2934ceaf06d7 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:00.653825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 411/808] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 19:25:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:25:02.356460 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8103-83a8-4b1b-9e27-a7cd1fec37a2 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:02.357024 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8103-83a8-4b1b-9e27-a7cd1fec37a2 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:02.357024 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8103-83a8-4b1b-9e27-a7cd1fec37a2 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:02.358366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 398/809] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:25:02.364785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a31e7-fd14-4560-9593-c8f0b12557e2 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:02.365477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a31e7-fd14-4560-9593-c8f0b12557e2 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:02.365618 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a31e7-fd14-4560-9593-c8f0b12557e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:02.394136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-117a31e7-fd14-4560-9593-c8f0b12557e2 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:25:02.396795 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-117a31e7-fd14-4560-9593-c8f0b12557e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:25:02.421785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:25:02.478415 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 412/810] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:25:02 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:25:02.798613 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a8103-83a8-4b1b-9e27-a7cd1fec37a2 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:02.906798 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a8103-83a8-4b1b-9e27-a7cd1fec37a2 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:02.921486 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:25:02.943300 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c79408-1c1d-4a5b-8598-c8600ce941a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:02.943908 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79408-1c1d-4a5b-8598-c8600ce941a8 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:02.944183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79408-1c1d-4a5b-8598-c8600ce941a8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:02.944453 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79408-1c1d-4a5b-8598-c8600ce941a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:02.945014 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c79408-1c1d-4a5b-8598-c8600ce941a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:02.946415 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c79408-1c1d-4a5b-8598-c8600ce941a8 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-49c79408-1c1d-4a5b-8598-c8600ce941a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:25:02.955653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:25:02.956740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:25:02.957709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:25:02.961774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 399/811] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:25:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:25:02.963285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a31e7-fd14-4560-9593-c8f0b12557e2 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:03.067635 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a31e7-fd14-4560-9593-c8f0b12557e2 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:03.104963 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae641b-4373-4b80-856e-6f88f61d79e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:03.105598 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae641b-4373-4b80-856e-6f88f61d79e3 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:03.105965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae641b-4373-4b80-856e-6f88f61d79e3 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:03.106268 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae641b-4373-4b80-856e-6f88f61d79e3 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:03.106858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae641b-4373-4b80-856e-6f88f61d79e3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:25:03.107188 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae641b-4373-4b80-856e-6f88f61d79e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:03.108605 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae641b-4373-4b80-856e-6f88f61d79e3 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:03.113723 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 413/812] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:25:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:25:03.120541 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c79408-1c1d-4a5b-8598-c8600ce941a8 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:03.234251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c79408-1c1d-4a5b-8598-c8600ce941a8 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:03.269577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605801-8e41-4086-8c14-62bda988d242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:03.270194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605801-8e41-4086-8c14-62bda988d242 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:03.270470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605801-8e41-4086-8c14-62bda988d242 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:03.270736 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605801-8e41-4086-8c14-62bda988d242 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:03.271354 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605801-8e41-4086-8c14-62bda988d242 None admin] RBAC: Adding query filter params (type=compute) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:25:03.271648 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605801-8e41-4086-8c14-62bda988d242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:03.273014 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605801-8e41-4086-8c14-62bda988d242 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:03.278111 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 400/813] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:25:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:25:03.284498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae641b-4373-4b80-856e-6f88f61d79e3 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:03.305668 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:25:03.388608 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae641b-4373-4b80-856e-6f88f61d79e3 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:03.424703 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c1db0-4190-45cb-868a-c5b276563859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:03.425300 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1db0-4190-45cb-868a-c5b276563859 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:03.425570 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1db0-4190-45cb-868a-c5b276563859 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:03.425845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1db0-4190-45cb-868a-c5b276563859 None admin] PATH_INFO: `/v3/endpoints` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:03.426571 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c1db0-4190-45cb-868a-c5b276563859 None admin] RBAC: Adding query filter params (interface=public, service_id=6c62a2cab9ac43149f0e9678e6e682c6, region_id=RegionOne) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:25:03.426872 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c1db0-4190-45cb-868a-c5b276563859 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:03.428248 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c1db0-4190-45cb-868a-c5b276563859 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:03.433794 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 414/814] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 19:25:03 2022] GET /identity/v3/endpoints?service_id=6c62a2cab9ac43149f0e9678e6e682c6&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:25:03.439868 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605801-8e41-4086-8c14-62bda988d242 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:03.495246 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:25:03.558074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605801-8e41-4086-8c14-62bda988d242 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:03.596547 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494cded-a761-4e6d-90cf-16d0f1c426f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:03.597446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494cded-a761-4e6d-90cf-16d0f1c426f1 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:03.597797 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494cded-a761-4e6d-90cf-16d0f1c426f1 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:03.598154 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494cded-a761-4e6d-90cf-16d0f1c426f1 None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:03.599056 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494cded-a761-4e6d-90cf-16d0f1c426f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:03.601189 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494cded-a761-4e6d-90cf-16d0f1c426f1 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:03.611497 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 401/815] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 19:25:03 2022] GET /identity/v3/services => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:25:05.794547 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24013fc-1f9f-42f8-9bac-77aa2c25078b None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:05.795121 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24013fc-1f9f-42f8-9bac-77aa2c25078b None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:05.795121 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24013fc-1f9f-42f8-9bac-77aa2c25078b None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:05.797086 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 415/816] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:25:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:25:05.802508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3c5bd-b8b0-4e6f-bd4f-f4b3b2507920 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:05.802932 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3c5bd-b8b0-4e6f-bd4f-f4b3b2507920 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:05.803021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3c5bd-b8b0-4e6f-bd4f-f4b3b2507920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:05.822433 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-c9a3c5bd-b8b0-4e6f-bd4f-f4b3b2507920 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:25:05.823632 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-c9a3c5bd-b8b0-4e6f-bd4f-f4b3b2507920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:25:05.893475 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 402/817] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:25:05 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:25:06.215934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24013fc-1f9f-42f8-9bac-77aa2c25078b None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:06.324561 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:25:06.350783 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24013fc-1f9f-42f8-9bac-77aa2c25078b None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:06.387572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10dcb4-5920-42c5-a9f5-056f867e57ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:06.388200 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10dcb4-5920-42c5-a9f5-056f867e57ec None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:06.388474 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10dcb4-5920-42c5-a9f5-056f867e57ec None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:06.388741 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10dcb4-5920-42c5-a9f5-056f867e57ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:06.389324 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10dcb4-5920-42c5-a9f5-056f867e57ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:06.390736 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10dcb4-5920-42c5-a9f5-056f867e57ec None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-9f10dcb4-5920-42c5-a9f5-056f867e57ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:25:06.399356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:25:06.400357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:25:06.401203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 416/818] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:25:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:25:06.406893 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3c5bd-b8b0-4e6f-bd4f-f4b3b2507920 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:06.444043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:25:06.511789 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3c5bd-b8b0-4e6f-bd4f-f4b3b2507920 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:06.548679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792100b0-2682-4f55-9c19-30d9a14693ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:06.549239 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792100b0-2682-4f55-9c19-30d9a14693ce None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:06.549507 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792100b0-2682-4f55-9c19-30d9a14693ce None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:06.549771 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792100b0-2682-4f55-9c19-30d9a14693ce None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:06.550426 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792100b0-2682-4f55-9c19-30d9a14693ce None admin] RBAC: Adding query filter params (name=compute) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:25:06.550725 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792100b0-2682-4f55-9c19-30d9a14693ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:06.552099 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792100b0-2682-4f55-9c19-30d9a14693ce None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:06.557066 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 403/819] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:25:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:25:06.563206 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10dcb4-5920-42c5-a9f5-056f867e57ec None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:06.692351 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10dcb4-5920-42c5-a9f5-056f867e57ec None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:06.731330 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95f237-b62f-4f4c-9996-4d5ab253a1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:06.731931 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f237-b62f-4f4c-9996-4d5ab253a1e6 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:06.732214 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f237-b62f-4f4c-9996-4d5ab253a1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:06.732472 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f237-b62f-4f4c-9996-4d5ab253a1e6 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:06.733087 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95f237-b62f-4f4c-9996-4d5ab253a1e6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:25:06.733384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95f237-b62f-4f4c-9996-4d5ab253a1e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:06.734795 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95f237-b62f-4f4c-9996-4d5ab253a1e6 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:06.739487 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 417/820] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 19:25:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:25:06.745616 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792100b0-2682-4f55-9c19-30d9a14693ce None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:06.851565 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:25:06.855007 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792100b0-2682-4f55-9c19-30d9a14693ce None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:06.890539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42080-ac52-4b39-a11b-76a30002eecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:06.891133 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42080-ac52-4b39-a11b-76a30002eecf None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:06.891399 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42080-ac52-4b39-a11b-76a30002eecf None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:06.891649 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42080-ac52-4b39-a11b-76a30002eecf None admin] PATH_INFO: `/v3/endpoints` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:06.892296 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e42080-ac52-4b39-a11b-76a30002eecf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:06.893650 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e42080-ac52-4b39-a11b-76a30002eecf None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:06.916386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 404/821] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:25:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:25:16.737327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=95 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:25:16.912012 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=21,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:10.000540 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f65b6-9d12-49e5-96fc-9e055ae041aa None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:10.001441 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f65b6-9d12-49e5-96fc-9e055ae041aa None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:10.001441 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f65b6-9d12-49e5-96fc-9e055ae041aa None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:10.002824 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 418/822] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:10.009353 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85ae61-f1e8-41ca-8de0-594d78eb083f None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:10.009943 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85ae61-f1e8-41ca-8de0-594d78eb083f None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:10.009943 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85ae61-f1e8-41ca-8de0-594d78eb083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:10.031404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-4e85ae61-f1e8-41ca-8de0-594d78eb083f None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:10.032659 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-4e85ae61-f1e8-41ca-8de0-594d78eb083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:10.124772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 405/823] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:26:10 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:26:10.500247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f65b6-9d12-49e5-96fc-9e055ae041aa None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:10.626535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f65b6-9d12-49e5-96fc-9e055ae041aa None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:10.667736 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9509f8-9e16-464d-a9d0-7d1fdfef7574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:10.668945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9509f8-9e16-464d-a9d0-7d1fdfef7574 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:10.669149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9509f8-9e16-464d-a9d0-7d1fdfef7574 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:10.669519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9509f8-9e16-464d-a9d0-7d1fdfef7574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:10.683227 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9509f8-9e16-464d-a9d0-7d1fdfef7574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:10.685289 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9509f8-9e16-464d-a9d0-7d1fdfef7574 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-ee9509f8-9e16-464d-a9d0-7d1fdfef7574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:10.701498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:10.702702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:10.704871 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:10.704871 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:10.704871 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:10.704871 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 419/824] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:10.709742 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85ae61-f1e8-41ca-8de0-594d78eb083f None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:10.823957 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85ae61-f1e8-41ca-8de0-594d78eb083f None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:10.853939 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:10.864376 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3d4e0-6501-4b94-b0bb-66e78d9d831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:10.864990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3d4e0-6501-4b94-b0bb-66e78d9d831c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:10.865266 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3d4e0-6501-4b94-b0bb-66e78d9d831c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:10.865533 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3d4e0-6501-4b94-b0bb-66e78d9d831c None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:10.866205 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3d4e0-6501-4b94-b0bb-66e78d9d831c None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:10.866506 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3d4e0-6501-4b94-b0bb-66e78d9d831c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:10.867878 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3d4e0-6501-4b94-b0bb-66e78d9d831c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:10.885649 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 406/825] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:10.892398 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9509f8-9e16-464d-a9d0-7d1fdfef7574 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:10.958380 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:11.019956 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9509f8-9e16-464d-a9d0-7d1fdfef7574 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:11.074657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57575ace-6a36-43c8-b5da-b1a1facd8b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:11.075219 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57575ace-6a36-43c8-b5da-b1a1facd8b15 None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:11.075544 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57575ace-6a36-43c8-b5da-b1a1facd8b15 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:11.075780 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57575ace-6a36-43c8-b5da-b1a1facd8b15 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:11.076587 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57575ace-6a36-43c8-b5da-b1a1facd8b15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:11.078051 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57575ace-6a36-43c8-b5da-b1a1facd8b15 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:11.105568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 420/826] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 19:26:10 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:26:13.536860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b83c9-0696-43c1-848b-04cf58fad62e None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:13.537552 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b83c9-0696-43c1-848b-04cf58fad62e None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:13.537552 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b83c9-0696-43c1-848b-04cf58fad62e None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:13.538960 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 407/827] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:13.545301 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11613e-6e22-459b-9459-3e1b8fda3d05 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:13.545777 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11613e-6e22-459b-9459-3e1b8fda3d05 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:13.545943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11613e-6e22-459b-9459-3e1b8fda3d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:13.567880 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-4d11613e-6e22-459b-9459-3e1b8fda3d05 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:13.569460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-4d11613e-6e22-459b-9459-3e1b8fda3d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:13.643547 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 421/828] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:26:13 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:26:13.965397 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b83c9-0696-43c1-848b-04cf58fad62e None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:14.080943 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b83c9-0696-43c1-848b-04cf58fad62e None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:14.119976 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c3a51-71eb-41fb-a907-8353cb3ebc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:14.120655 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c3a51-71eb-41fb-a907-8353cb3ebc1a None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:14.120874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c3a51-71eb-41fb-a907-8353cb3ebc1a None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:14.121162 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c3a51-71eb-41fb-a907-8353cb3ebc1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:14.134352 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c3a51-71eb-41fb-a907-8353cb3ebc1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-703c3a51-71eb-41fb-a907-8353cb3ebc1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:26:14.139967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:14.140988 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:14.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 408/829] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:26:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:14.147628 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11613e-6e22-459b-9459-3e1b8fda3d05 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:14.191413 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:14.260605 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11613e-6e22-459b-9459-3e1b8fda3d05 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:14.298174 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cae52c-2ea7-441f-b1f5-5c4e411fdfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:14.298794 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae52c-2ea7-441f-b1f5-5c4e411fdfb7 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:14.299075 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae52c-2ea7-441f-b1f5-5c4e411fdfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:14.299356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae52c-2ea7-441f-b1f5-5c4e411fdfb7 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:14.300069 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cae52c-2ea7-441f-b1f5-5c4e411fdfb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:14.300372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cae52c-2ea7-441f-b1f5-5c4e411fdfb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:14.301830 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cae52c-2ea7-441f-b1f5-5c4e411fdfb7 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:14.311133 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 422/830] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:26:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:26:14.318010 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c3a51-71eb-41fb-a907-8353cb3ebc1a None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:14.375764 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:14.439400 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c3a51-71eb-41fb-a907-8353cb3ebc1a None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:14.476411 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc926234-cb78-4b29-808f-2f67499ff68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:14.477040 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc926234-cb78-4b29-808f-2f67499ff68d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:14.477352 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc926234-cb78-4b29-808f-2f67499ff68d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:14.477629 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc926234-cb78-4b29-808f-2f67499ff68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:14.491493 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc926234-cb78-4b29-808f-2f67499ff68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:14.493591 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc926234-cb78-4b29-808f-2f67499ff68d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-fc926234-cb78-4b29-808f-2f67499ff68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:14.517707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:14.518779 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:14.519680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:14.519680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:14.519680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:14.519680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 409/831] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:14.525290 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cae52c-2ea7-441f-b1f5-5c4e411fdfb7 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:14.636238 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:14.640333 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cae52c-2ea7-441f-b1f5-5c4e411fdfb7 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:14.692374 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba2ff2-759d-4346-aa28-ea913713f315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:14.693314 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2ff2-759d-4346-aa28-ea913713f315 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:14.693743 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2ff2-759d-4346-aa28-ea913713f315 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:14.694169 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2ff2-759d-4346-aa28-ea913713f315 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:14.694998 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba2ff2-759d-4346-aa28-ea913713f315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:14.695397 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba2ff2-759d-4346-aa28-ea913713f315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:14.698492 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba2ff2-759d-4346-aa28-ea913713f315 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:14.712607 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 423/832] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:14.719828 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc926234-cb78-4b29-808f-2f67499ff68d None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:14.830666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:14.835409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc926234-cb78-4b29-808f-2f67499ff68d None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:14.871027 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67e55b-95b5-4d55-8b75-288a57e96eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:14.871701 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67e55b-95b5-4d55-8b75-288a57e96eb9 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:14.872010 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67e55b-95b5-4d55-8b75-288a57e96eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:14.872309 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67e55b-95b5-4d55-8b75-288a57e96eb9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:14.880324 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67e55b-95b5-4d55-8b75-288a57e96eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:14.881766 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67e55b-95b5-4d55-8b75-288a57e96eb9 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-8f67e55b-95b5-4d55-8b75-288a57e96eb9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:26:14.894021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:14.895444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:14.896647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:14.896647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:14.896647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:26:14.896647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:26:14.896647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:26:14.896647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:26:14.896647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:26:14.896647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:26:14.896647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:14.896647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:14.896647 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 410/833] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:14.901387 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba2ff2-759d-4346-aa28-ea913713f315 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:15.010339 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba2ff2-759d-4346-aa28-ea913713f315 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:15.044605 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4117eb-3e32-4742-b967-19b52391ccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:15.045215 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4117eb-3e32-4742-b967-19b52391ccdc None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:15.045492 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4117eb-3e32-4742-b967-19b52391ccdc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:15.045760 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4117eb-3e32-4742-b967-19b52391ccdc None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:15.046556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4117eb-3e32-4742-b967-19b52391ccdc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:15.046860 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4117eb-3e32-4742-b967-19b52391ccdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:15.048359 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4117eb-3e32-4742-b967-19b52391ccdc None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:15.066734 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 424/834] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 19:26:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:15.072829 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67e55b-95b5-4d55-8b75-288a57e96eb9 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:15.181335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67e55b-95b5-4d55-8b75-288a57e96eb9 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:15.222483 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ade50-8acf-4cbb-9d59-5b4779792781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:15.223637 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ade50-8acf-4cbb-9d59-5b4779792781 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:15.223637 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ade50-8acf-4cbb-9d59-5b4779792781 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:15.223637 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ade50-8acf-4cbb-9d59-5b4779792781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:15.252782 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:15.296129 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ade50-8acf-4cbb-9d59-5b4779792781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:15.297580 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ade50-8acf-4cbb-9d59-5b4779792781 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:15.400420 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 411/835] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:26:15 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 19:26:15.406341 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4117eb-3e32-4742-b967-19b52391ccdc None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:15.426878 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:15.513796 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4117eb-3e32-4742-b967-19b52391ccdc None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:15.551029 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5524a-0509-4dfb-9394-6e9efb10937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:15.551766 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5524a-0509-4dfb-9394-6e9efb10937b None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:15.552099 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5524a-0509-4dfb-9394-6e9efb10937b None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:15.552407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5524a-0509-4dfb-9394-6e9efb10937b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:15.564737 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5524a-0509-4dfb-9394-6e9efb10937b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:15.566240 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5524a-0509-4dfb-9394-6e9efb10937b None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-9ff5524a-0509-4dfb-9394-6e9efb10937b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:15.581954 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:15.583344 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:15.584606 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:15.584606 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:15.584606 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:15.590049 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 425/836] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:15.590205 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ade50-8acf-4cbb-9d59-5b4779792781 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:15.649425 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:15.694448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ade50-8acf-4cbb-9d59-5b4779792781 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:15.730933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b073c-6c33-4973-9963-9d0b6144618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:15.732293 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b073c-6c33-4973-9963-9d0b6144618e None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:15.732293 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b073c-6c33-4973-9963-9d0b6144618e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:15.732293 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b073c-6c33-4973-9963-9d0b6144618e None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:15.732919 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b073c-6c33-4973-9963-9d0b6144618e None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:15.733221 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b073c-6c33-4973-9963-9d0b6144618e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:15.734639 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b073c-6c33-4973-9963-9d0b6144618e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:15.746763 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 412/837] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:26:15.752648 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5524a-0509-4dfb-9394-6e9efb10937b None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:15.835104 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:15.868577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5524a-0509-4dfb-9394-6e9efb10937b None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:15.908204 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28067c3b-8071-46ff-b7f8-13502574c9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:15.908845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067c3b-8071-46ff-b7f8-13502574c9c4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:15.909123 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067c3b-8071-46ff-b7f8-13502574c9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:15.909396 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067c3b-8071-46ff-b7f8-13502574c9c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:15.917377 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28067c3b-8071-46ff-b7f8-13502574c9c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:15.918978 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28067c3b-8071-46ff-b7f8-13502574c9c4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-28067c3b-8071-46ff-b7f8-13502574c9c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:26:15.931348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:15.932523 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:15.933719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:26:15.933719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:26:15.933719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:26:15.933719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:26:15.933719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:26:15.933719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:26:15.933719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:15.933719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:15.933719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 426/838] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:15.938973 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b073c-6c33-4973-9963-9d0b6144618e None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:16.050165 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b073c-6c33-4973-9963-9d0b6144618e None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:16.068102 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:16.088657 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b7780-cbd5-44ac-b5db-12ff00ac197d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:16.089191 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b7780-cbd5-44ac-b5db-12ff00ac197d None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:16.089468 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b7780-cbd5-44ac-b5db-12ff00ac197d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:16.089740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b7780-cbd5-44ac-b5db-12ff00ac197d None admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:16.090522 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b7780-cbd5-44ac-b5db-12ff00ac197d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:16.091166 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b7780-cbd5-44ac-b5db-12ff00ac197d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:16.092281 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b7780-cbd5-44ac-b5db-12ff00ac197d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:16.111386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 413/839] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:16.118109 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28067c3b-8071-46ff-b7f8-13502574c9c4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:16.238439 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28067c3b-8071-46ff-b7f8-13502574c9c4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:16.270870 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:16.278045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc4294-ac3f-47d3-9902-86016d36086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:16.278668 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc4294-ac3f-47d3-9902-86016d36086e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:16.278937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc4294-ac3f-47d3-9902-86016d36086e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:16.279199 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc4294-ac3f-47d3-9902-86016d36086e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:16.279918 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc4294-ac3f-47d3-9902-86016d36086e None admin] RBAC: Adding query filter params (role.id=db8abf37adff4704889523e773b95924, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=35957952c2a142ba868279f19ab4d46d) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:16.280221 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc4294-ac3f-47d3-9902-86016d36086e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:16.281663 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc4294-ac3f-47d3-9902-86016d36086e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:16.288701 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 427/840] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:26:16 2022] GET /identity/v3/role_assignments?user.id=35957952c2a142ba868279f19ab4d46d&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=db8abf37adff4704889523e773b95924 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:26:18.562453 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d53ff-334d-488d-a504-355441393bb4 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:18.563024 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d53ff-334d-488d-a504-355441393bb4 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:18.563024 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d53ff-334d-488d-a504-355441393bb4 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:18.564307 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 414/841] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:26:18.571301 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972870-9dd4-4937-951e-9a9d16a4357b None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:18.571713 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972870-9dd4-4937-951e-9a9d16a4357b None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:18.571994 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972870-9dd4-4937-951e-9a9d16a4357b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:18.593413 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-ca972870-9dd4-4937-951e-9a9d16a4357b None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:18.594654 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-ca972870-9dd4-4937-951e-9a9d16a4357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:18.671921 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 428/842] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:26:18 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:26:19.019568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d53ff-334d-488d-a504-355441393bb4 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:19.133391 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d53ff-334d-488d-a504-355441393bb4 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:19.177152 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b09a11-3072-4324-95ca-4047943fdace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:19.178557 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09a11-3072-4324-95ca-4047943fdace None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:19.179154 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09a11-3072-4324-95ca-4047943fdace None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:19.179750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09a11-3072-4324-95ca-4047943fdace None admin] PATH_INFO: `/v3/roles/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:19.196963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b09a11-3072-4324-95ca-4047943fdace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-b4b09a11-3072-4324-95ca-4047943fdace None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:26:19.203706 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:19.205110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:26:19.206200 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:19.208960 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 415/843] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:26:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:19.214799 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca972870-9dd4-4937-951e-9a9d16a4357b None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:19.330653 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca972870-9dd4-4937-951e-9a9d16a4357b None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:19.358024 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:19.374308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ef04a-69d0-4f69-8076-ff8b67826dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:19.375272 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ef04a-69d0-4f69-8076-ff8b67826dd8 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:19.375690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ef04a-69d0-4f69-8076-ff8b67826dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:19.376103 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ef04a-69d0-4f69-8076-ff8b67826dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:19.377102 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ef04a-69d0-4f69-8076-ff8b67826dd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:19.377502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ef04a-69d0-4f69-8076-ff8b67826dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:19.379320 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ef04a-69d0-4f69-8076-ff8b67826dd8 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:19.391963 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 429/844] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:26:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:19.399303 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b09a11-3072-4324-95ca-4047943fdace None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:19.459783 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:19.532238 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b09a11-3072-4324-95ca-4047943fdace None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:19.569247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381868cc-0560-4ef7-90ca-add4024a10d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:19.569934 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381868cc-0560-4ef7-90ca-add4024a10d8 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:19.570246 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381868cc-0560-4ef7-90ca-add4024a10d8 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:19.570506 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381868cc-0560-4ef7-90ca-add4024a10d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:19.582893 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381868cc-0560-4ef7-90ca-add4024a10d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:19.584530 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381868cc-0560-4ef7-90ca-add4024a10d8 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-381868cc-0560-4ef7-90ca-add4024a10d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:19.599928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:19.601119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:19.602199 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:19.602199 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:19.602199 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:19.602199 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 416/845] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:19.607285 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ef04a-69d0-4f69-8076-ff8b67826dd8 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:19.725900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ef04a-69d0-4f69-8076-ff8b67826dd8 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:19.765022 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4859789-e057-44e3-88d5-a51c6b5991b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:19.765626 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4859789-e057-44e3-88d5-a51c6b5991b8 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:19.765900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4859789-e057-44e3-88d5-a51c6b5991b8 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:19.766218 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4859789-e057-44e3-88d5-a51c6b5991b8 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:19.766833 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4859789-e057-44e3-88d5-a51c6b5991b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:19.767128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4859789-e057-44e3-88d5-a51c6b5991b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:19.768498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4859789-e057-44e3-88d5-a51c6b5991b8 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:19.780878 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 430/846] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:19.786877 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381868cc-0560-4ef7-90ca-add4024a10d8 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:19.889948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:19.900822 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381868cc-0560-4ef7-90ca-add4024a10d8 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:19.938267 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734d960-e251-40bb-a99b-88f98a38cf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:19.938918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734d960-e251-40bb-a99b-88f98a38cf45 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:19.939212 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734d960-e251-40bb-a99b-88f98a38cf45 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:19.939501 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734d960-e251-40bb-a99b-88f98a38cf45 None admin] PATH_INFO: `/v3/users/placement` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:19.949097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734d960-e251-40bb-a99b-88f98a38cf45 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:19.950905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734d960-e251-40bb-a99b-88f98a38cf45 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-d734d960-e251-40bb-a99b-88f98a38cf45 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:26:19.962116 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:19.963110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:19.964132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:19.964132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:19.964132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:26:19.964132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:26:19.964132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:26:19.964132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:26:19.964132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:26:19.964132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:26:19.964132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:19.964132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:19.964132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 417/847] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:19.969839 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4859789-e057-44e3-88d5-a51c6b5991b8 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:20.024749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:20.082657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4859789-e057-44e3-88d5-a51c6b5991b8 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:20.119490 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63026621-b3a8-4ed6-b655-ed6f60f77578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:20.120177 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026621-b3a8-4ed6-b655-ed6f60f77578 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:20.120463 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026621-b3a8-4ed6-b655-ed6f60f77578 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:20.120736 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026621-b3a8-4ed6-b655-ed6f60f77578 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:20.121826 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63026621-b3a8-4ed6-b655-ed6f60f77578 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:20.122433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63026621-b3a8-4ed6-b655-ed6f60f77578 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:20.123800 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63026621-b3a8-4ed6-b655-ed6f60f77578 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:20.144560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 431/848] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 19:26:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:20.150642 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734d960-e251-40bb-a99b-88f98a38cf45 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:20.269258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734d960-e251-40bb-a99b-88f98a38cf45 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:20.311725 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1eec3-7d08-4f67-8cf7-852c2c9b5ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:20.312352 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1eec3-7d08-4f67-8cf7-852c2c9b5ccd None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:20.312622 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1eec3-7d08-4f67-8cf7-852c2c9b5ccd None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:20.312916 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1eec3-7d08-4f67-8cf7-852c2c9b5ccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:20.324036 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1eec3-7d08-4f67-8cf7-852c2c9b5ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:20.325530 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1eec3-7d08-4f67-8cf7-852c2c9b5ccd None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-74b1eec3-7d08-4f67-8cf7-852c2c9b5ccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:20.339470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:20.341105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:20.342028 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:20.342028 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:20.342028 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:20.342028 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 418/849] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:20.347807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63026621-b3a8-4ed6-b655-ed6f60f77578 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:20.460656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63026621-b3a8-4ed6-b655-ed6f60f77578 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:20.461380 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:20.498092 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b572b-2007-4cb6-9143-60b17500cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:20.498714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b572b-2007-4cb6-9143-60b17500cb54 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:20.498992 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b572b-2007-4cb6-9143-60b17500cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:20.499263 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b572b-2007-4cb6-9143-60b17500cb54 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:20.499904 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b572b-2007-4cb6-9143-60b17500cb54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:20.500221 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b572b-2007-4cb6-9143-60b17500cb54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:20.501592 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b572b-2007-4cb6-9143-60b17500cb54 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:20.515796 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 432/850] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:20.522021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1eec3-7d08-4f67-8cf7-852c2c9b5ccd None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:20.524665 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:20.630620 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1eec3-7d08-4f67-8cf7-852c2c9b5ccd None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:20.667657 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7daa0e-af63-4aff-b746-3b564dd02e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:20.668393 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7daa0e-af63-4aff-b746-3b564dd02e3e None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:20.669159 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7daa0e-af63-4aff-b746-3b564dd02e3e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:20.669505 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7daa0e-af63-4aff-b746-3b564dd02e3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:20.677288 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7daa0e-af63-4aff-b746-3b564dd02e3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:20.678796 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7daa0e-af63-4aff-b746-3b564dd02e3e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-fd7daa0e-af63-4aff-b746-3b564dd02e3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:26:20.691508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:20.692734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:20.693925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:26:20.693925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:26:20.693925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:26:20.693925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:26:20.693925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:26:20.693925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:26:20.693925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:20.693925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:20.693925 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 419/851] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:26:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:20.699887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b572b-2007-4cb6-9143-60b17500cb54 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:20.826838 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b572b-2007-4cb6-9143-60b17500cb54 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:20.866424 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8b974-26ff-442f-953e-888e952b5e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:20.867063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8b974-26ff-442f-953e-888e952b5e71 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:20.867358 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8b974-26ff-442f-953e-888e952b5e71 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:20.867626 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8b974-26ff-442f-953e-888e952b5e71 None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:20.868416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8b974-26ff-442f-953e-888e952b5e71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:20.868744 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8b974-26ff-442f-953e-888e952b5e71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:20.870322 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8b974-26ff-442f-953e-888e952b5e71 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:20.883413 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 433/852] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:26:20.890036 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7daa0e-af63-4aff-b746-3b564dd02e3e None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:20.957752 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:21.003240 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7daa0e-af63-4aff-b746-3b564dd02e3e None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:21.038353 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21249bb1-9708-455f-a526-361b7bcd200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:21.039028 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249bb1-9708-455f-a526-361b7bcd200b None admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:21.039290 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249bb1-9708-455f-a526-361b7bcd200b None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:21.039914 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249bb1-9708-455f-a526-361b7bcd200b None admin] PATH_INFO: `/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/35957952c2a142ba868279f19ab4d46d/roles/db8abf37adff4704889523e773b95924` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:21.055724 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21249bb1-9708-455f-a526-361b7bcd200b None admin] RBAC: Authorizing `identity:create_grant(project_id=a186fc1651b442d4b704b88a3dddf1b0, user_id=35957952c2a142ba868279f19ab4d46d, role_id=db8abf37adff4704889523e773b95924)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:21.057163 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21249bb1-9708-455f-a526-361b7bcd200b None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:21.072598 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 420/853] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:26:20 2022] PUT /identity/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/35957952c2a142ba868279f19ab4d46d/roles/db8abf37adff4704889523e773b95924 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:26:23.407017 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188df86-a603-43a2-be18-4d2fa2ce9aaf None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:23.407637 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188df86-a603-43a2-be18-4d2fa2ce9aaf None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:23.407637 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188df86-a603-43a2-be18-4d2fa2ce9aaf None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:23.409596 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 434/854] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:23.415775 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e61616-208f-44d3-a5c1-4b9d8c4b87ec None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:23.416335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e61616-208f-44d3-a5c1-4b9d8c4b87ec None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:23.416451 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e61616-208f-44d3-a5c1-4b9d8c4b87ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:23.437183 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-b0e61616-208f-44d3-a5c1-4b9d8c4b87ec None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:23.438452 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-b0e61616-208f-44d3-a5c1-4b9d8c4b87ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:23.521707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 421/855] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:26:23 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:26:23.874065 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188df86-a603-43a2-be18-4d2fa2ce9aaf None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:23.901807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:23.984945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188df86-a603-43a2-be18-4d2fa2ce9aaf None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:24.023985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab94b-9561-45f2-8d6c-a116208bc6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:24.024633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab94b-9561-45f2-8d6c-a116208bc6f4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:24.024907 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab94b-9561-45f2-8d6c-a116208bc6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:24.025180 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab94b-9561-45f2-8d6c-a116208bc6f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:24.035460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ab94b-9561-45f2-8d6c-a116208bc6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-335ab94b-9561-45f2-8d6c-a116208bc6f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:26:24.041229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:24.043050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:24.044295 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 435/856] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 19:26:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:24.048794 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e61616-208f-44d3-a5c1-4b9d8c4b87ec None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:24.098871 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:24.167318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e61616-208f-44d3-a5c1-4b9d8c4b87ec None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:24.205314 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86988cb2-6e00-44b7-9709-fab1559edca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:24.205961 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86988cb2-6e00-44b7-9709-fab1559edca9 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:24.206208 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86988cb2-6e00-44b7-9709-fab1559edca9 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:24.206477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86988cb2-6e00-44b7-9709-fab1559edca9 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:24.207134 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86988cb2-6e00-44b7-9709-fab1559edca9 None admin] RBAC: Adding query filter params (name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:24.207421 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86988cb2-6e00-44b7-9709-fab1559edca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:24.208788 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86988cb2-6e00-44b7-9709-fab1559edca9 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:24.218010 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 422/857] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 19:26:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:26:24.223861 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab94b-9561-45f2-8d6c-a116208bc6f4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:24.322740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:24.339266 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab94b-9561-45f2-8d6c-a116208bc6f4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:24.378666 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34a545-b598-4f37-8052-93f873b9abaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:24.379474 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34a545-b598-4f37-8052-93f873b9abaa None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:24.379795 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34a545-b598-4f37-8052-93f873b9abaa None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:24.380067 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34a545-b598-4f37-8052-93f873b9abaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:24.391619 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34a545-b598-4f37-8052-93f873b9abaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:24.393106 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34a545-b598-4f37-8052-93f873b9abaa None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-7d34a545-b598-4f37-8052-93f873b9abaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:24.411234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:24.418096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:24.420063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:24.420063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:24.420063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:24.420063 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 436/858] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:26:24.420302 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86988cb2-6e00-44b7-9709-fab1559edca9 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:24.531590 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86988cb2-6e00-44b7-9709-fab1559edca9 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:24.534415 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:24.568305 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a7df6-2ee6-480a-9af0-c4eb0ddaafa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:24.568954 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7df6-2ee6-480a-9af0-c4eb0ddaafa2 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:24.569176 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7df6-2ee6-480a-9af0-c4eb0ddaafa2 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:24.569442 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7df6-2ee6-480a-9af0-c4eb0ddaafa2 None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:24.570113 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a7df6-2ee6-480a-9af0-c4eb0ddaafa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:24.570412 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a7df6-2ee6-480a-9af0-c4eb0ddaafa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:24.571780 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a7df6-2ee6-480a-9af0-c4eb0ddaafa2 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:24.584059 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 423/859] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:24.589942 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34a545-b598-4f37-8052-93f873b9abaa None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:24.699432 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34a545-b598-4f37-8052-93f873b9abaa None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:24.739007 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07621-6877-4e37-bc95-1f728e8669b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:24.739761 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07621-6877-4e37-bc95-1f728e8669b6 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:24.740211 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07621-6877-4e37-bc95-1f728e8669b6 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:24.740673 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07621-6877-4e37-bc95-1f728e8669b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:24.744566 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:24.753456 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a07621-6877-4e37-bc95-1f728e8669b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:24.755549 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a07621-6877-4e37-bc95-1f728e8669b6 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-11a07621-6877-4e37-bc95-1f728e8669b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:26:24.770502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:24.771503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:24.772465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:24.772465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:24.772465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:26:24.772465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:26:24.772465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:26:24.772465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:26:24.772465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:26:24.772465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:26:24.772465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:24.772465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:24.772465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 437/860] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:24.778405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a7df6-2ee6-480a-9af0-c4eb0ddaafa2 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:24.896643 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a7df6-2ee6-480a-9af0-c4eb0ddaafa2 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:24.939551 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed85096-8bda-4007-a581-f1188078526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:24.940152 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed85096-8bda-4007-a581-f1188078526f None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:24.940421 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed85096-8bda-4007-a581-f1188078526f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:24.940682 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed85096-8bda-4007-a581-f1188078526f None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:24.941398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed85096-8bda-4007-a581-f1188078526f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:24.941690 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed85096-8bda-4007-a581-f1188078526f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:24.943140 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed85096-8bda-4007-a581-f1188078526f None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:24.962208 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 424/861] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 19:26:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:26:24.967581 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07621-6877-4e37-bc95-1f728e8669b6 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:25.095775 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07621-6877-4e37-bc95-1f728e8669b6 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:25.137378 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2c70-86a0-486c-94f6-c51bcd154a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:25.138109 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2c70-86a0-486c-94f6-c51bcd154a7a None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:25.138549 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2c70-86a0-486c-94f6-c51bcd154a7a None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:25.138923 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2c70-86a0-486c-94f6-c51bcd154a7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:25.218044 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:25.227994 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c2c70-86a0-486c-94f6-c51bcd154a7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:25.229509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c2c70-86a0-486c-94f6-c51bcd154a7a None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:25.353841 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 438/862] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:26:24 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 19:26:25.360122 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed85096-8bda-4007-a581-f1188078526f None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:25.386023 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:25.477248 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed85096-8bda-4007-a581-f1188078526f None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:25.512495 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887eb67-d3ae-4648-97a2-1705e4f23e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:25.513186 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887eb67-d3ae-4648-97a2-1705e4f23e01 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:25.513456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887eb67-d3ae-4648-97a2-1705e4f23e01 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:25.513720 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887eb67-d3ae-4648-97a2-1705e4f23e01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:25.524152 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887eb67-d3ae-4648-97a2-1705e4f23e01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:25.525589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887eb67-d3ae-4648-97a2-1705e4f23e01 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-5887eb67-d3ae-4648-97a2-1705e4f23e01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:25.541759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:25.542978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:25.544369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:25.544369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:25.544369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:25.544369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 425/863] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:25.549465 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2c70-86a0-486c-94f6-c51bcd154a7a None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:25.653098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:25.659731 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2c70-86a0-486c-94f6-c51bcd154a7a None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:25.700602 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba635d9-99f7-4725-9482-d4d0b580d232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:25.701529 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba635d9-99f7-4725-9482-d4d0b580d232 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:25.701928 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba635d9-99f7-4725-9482-d4d0b580d232 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:25.702299 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba635d9-99f7-4725-9482-d4d0b580d232 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:25.702958 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba635d9-99f7-4725-9482-d4d0b580d232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:25.703346 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba635d9-99f7-4725-9482-d4d0b580d232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:25.705010 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba635d9-99f7-4725-9482-d4d0b580d232 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:25.720087 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 439/864] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:26:25.726248 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887eb67-d3ae-4648-97a2-1705e4f23e01 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:25.820946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:25.849473 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887eb67-d3ae-4648-97a2-1705e4f23e01 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:25.888982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c11276-5c05-413d-a0c9-99cae3676075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:25.889615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c11276-5c05-413d-a0c9-99cae3676075 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:25.889884 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c11276-5c05-413d-a0c9-99cae3676075 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:25.890185 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c11276-5c05-413d-a0c9-99cae3676075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:25.896994 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c11276-5c05-413d-a0c9-99cae3676075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:25.898598 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c11276-5c05-413d-a0c9-99cae3676075 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-04c11276-5c05-413d-a0c9-99cae3676075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:26:25.911513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:25.912722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:25.914145 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:26:25.914145 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:26:25.914145 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:26:25.914145 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:26:25.914145 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:26:25.914145 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:26:25.914145 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:25.914145 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:25.914145 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 426/865] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:26:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:25.919101 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba635d9-99f7-4725-9482-d4d0b580d232 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:26.044272 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba635d9-99f7-4725-9482-d4d0b580d232 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:26.104745 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503887e-96a2-4635-8675-4b40dceda47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:26.105283 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503887e-96a2-4635-8675-4b40dceda47b None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:26.105583 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503887e-96a2-4635-8675-4b40dceda47b None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:26.106203 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503887e-96a2-4635-8675-4b40dceda47b None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:26.107263 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503887e-96a2-4635-8675-4b40dceda47b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:26.107552 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503887e-96a2-4635-8675-4b40dceda47b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:26.109200 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503887e-96a2-4635-8675-4b40dceda47b None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:26.124959 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 440/866] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:26:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:26.131324 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c11276-5c05-413d-a0c9-99cae3676075 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:26.244455 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c11276-5c05-413d-a0c9-99cae3676075 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:26.286696 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854b281-3e4a-4045-a650-09b5a387b6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:26.287577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b281-3e4a-4045-a650-09b5a387b6a0 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:26.287963 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b281-3e4a-4045-a650-09b5a387b6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:26.288347 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b281-3e4a-4045-a650-09b5a387b6a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:26.289640 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854b281-3e4a-4045-a650-09b5a387b6a0 None admin] RBAC: Adding query filter params (role.id=db8abf37adff4704889523e773b95924, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=35957952c2a142ba868279f19ab4d46d) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:26.290125 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854b281-3e4a-4045-a650-09b5a387b6a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:26.292118 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854b281-3e4a-4045-a650-09b5a387b6a0 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:26.294801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:26.300568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 427/867] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:26:26 2022] GET /identity/v3/role_assignments?user.id=35957952c2a142ba868279f19ab4d46d&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=db8abf37adff4704889523e773b95924 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:28.696354 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9254-93a3-4337-9b89-9b46304d86e8 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:28.697021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9254-93a3-4337-9b89-9b46304d86e8 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:28.697021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9254-93a3-4337-9b89-9b46304d86e8 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:28.698272 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 441/868] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:28.704612 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13b97-a880-492a-9a25-0f97e1162aaa None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:28.705121 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13b97-a880-492a-9a25-0f97e1162aaa None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:28.705121 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13b97-a880-492a-9a25-0f97e1162aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:28.725922 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-3da13b97-a880-492a-9a25-0f97e1162aaa None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:28.727251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-3da13b97-a880-492a-9a25-0f97e1162aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:28.806636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 428/869] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:26:28 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:26:29.191755 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a9254-93a3-4337-9b89-9b46304d86e8 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:29.213937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:29.316517 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a9254-93a3-4337-9b89-9b46304d86e8 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:29.352641 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253a8a6-f31d-4f67-9473-0d94d07e60f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:29.353288 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253a8a6-f31d-4f67-9473-0d94d07e60f5 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.353560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253a8a6-f31d-4f67-9473-0d94d07e60f5 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.353827 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253a8a6-f31d-4f67-9473-0d94d07e60f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.363824 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253a8a6-f31d-4f67-9473-0d94d07e60f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-1253a8a6-f31d-4f67-9473-0d94d07e60f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:26:29.368498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:29.369443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:29.370366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 442/870] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:26:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:29.376079 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13b97-a880-492a-9a25-0f97e1162aaa None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:29.482281 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13b97-a880-492a-9a25-0f97e1162aaa None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:29.511064 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:29.520468 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2a71-70fd-4096-ac4c-5891108c4225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:29.521087 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2a71-70fd-4096-ac4c-5891108c4225 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.521364 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2a71-70fd-4096-ac4c-5891108c4225 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.521661 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2a71-70fd-4096-ac4c-5891108c4225 None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.522449 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2a71-70fd-4096-ac4c-5891108c4225 None admin] RBAC: Adding query filter params (name=admin) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:29.522786 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2a71-70fd-4096-ac4c-5891108c4225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:29.524273 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2a71-70fd-4096-ac4c-5891108c4225 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:29.534845 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 429/871] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:26:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:29.541246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253a8a6-f31d-4f67-9473-0d94d07e60f5 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:29.628822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:29.655935 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253a8a6-f31d-4f67-9473-0d94d07e60f5 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:29.695207 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b273622-07a9-4bf3-b166-429522d3f3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:29.695952 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b273622-07a9-4bf3-b166-429522d3f3cf None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.696256 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b273622-07a9-4bf3-b166-429522d3f3cf None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.696561 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b273622-07a9-4bf3-b166-429522d3f3cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.708999 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b273622-07a9-4bf3-b166-429522d3f3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:29.710779 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b273622-07a9-4bf3-b166-429522d3f3cf None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-0b273622-07a9-4bf3-b166-429522d3f3cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:29.728892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:29.735726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:29.738082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:29.738082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:29.738082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:29.738082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 443/872] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:29.738626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2a71-70fd-4096-ac4c-5891108c4225 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:29.853630 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2a71-70fd-4096-ac4c-5891108c4225 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:29.892577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a16f9-afe8-4bcc-95fc-137f3a23f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:29.893216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a16f9-afe8-4bcc-95fc-137f3a23f2bc None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.893525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a16f9-afe8-4bcc-95fc-137f3a23f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.893796 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a16f9-afe8-4bcc-95fc-137f3a23f2bc None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.894465 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a16f9-afe8-4bcc-95fc-137f3a23f2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:29.894767 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a16f9-afe8-4bcc-95fc-137f3a23f2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:29.896141 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a16f9-afe8-4bcc-95fc-137f3a23f2bc None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:29.914966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 430/873] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:26:29.916184 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b273622-07a9-4bf3-b166-429522d3f3cf None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:30.036935 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b273622-07a9-4bf3-b166-429522d3f3cf None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:30.065322 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:30.074248 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efbbab-cf0b-4889-9931-10be317907b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:30.074957 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbbab-cf0b-4889-9931-10be317907b3 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:30.075255 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbbab-cf0b-4889-9931-10be317907b3 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:30.075538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbbab-cf0b-4889-9931-10be317907b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:30.083694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efbbab-cf0b-4889-9931-10be317907b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:30.085145 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efbbab-cf0b-4889-9931-10be317907b3 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-88efbbab-cf0b-4889-9931-10be317907b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:26:30.097057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:30.098253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:30.099407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:30.099407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:30.099407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:26:30.099407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:26:30.099407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:26:30.099407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:26:30.099407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:26:30.099407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:26:30.099407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:30.099407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:30.099407 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 444/874] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:26:30.104365 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a16f9-afe8-4bcc-95fc-137f3a23f2bc None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:30.160606 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:30.224438 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a16f9-afe8-4bcc-95fc-137f3a23f2bc None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:30.262995 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a38d2c-b819-4b86-8a01-149ffe1bef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:30.263934 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a38d2c-b819-4b86-8a01-149ffe1bef20 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:30.264230 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a38d2c-b819-4b86-8a01-149ffe1bef20 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:30.264529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a38d2c-b819-4b86-8a01-149ffe1bef20 None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:30.265319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a38d2c-b819-4b86-8a01-149ffe1bef20 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:30.265658 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a38d2c-b819-4b86-8a01-149ffe1bef20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:30.267235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a38d2c-b819-4b86-8a01-149ffe1bef20 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:30.285695 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 431/875] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 19:26:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:30.292035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efbbab-cf0b-4889-9931-10be317907b3 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:30.414026 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efbbab-cf0b-4889-9931-10be317907b3 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:30.451399 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009445e2-6610-4e91-8501-9f7517b87dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:30.451962 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009445e2-6610-4e91-8501-9f7517b87dfb None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:30.452240 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009445e2-6610-4e91-8501-9f7517b87dfb None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:30.452508 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009445e2-6610-4e91-8501-9f7517b87dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:30.514135 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:30.528643 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009445e2-6610-4e91-8501-9f7517b87dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:30.530308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009445e2-6610-4e91-8501-9f7517b87dfb None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:30.640973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 445/876] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:26:30 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 19:26:30.647050 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a38d2c-b819-4b86-8a01-149ffe1bef20 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:30.772101 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a38d2c-b819-4b86-8a01-149ffe1bef20 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:30.784920 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:30.815411 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8154ae3-bbdf-487e-93cf-44e55555f65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:30.816046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8154ae3-bbdf-487e-93cf-44e55555f65c None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:30.816317 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8154ae3-bbdf-487e-93cf-44e55555f65c None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:30.816611 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8154ae3-bbdf-487e-93cf-44e55555f65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:30.828806 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8154ae3-bbdf-487e-93cf-44e55555f65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:30.830306 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8154ae3-bbdf-487e-93cf-44e55555f65c None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-a8154ae3-bbdf-487e-93cf-44e55555f65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:30.846626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:30.847645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:30.849035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:30.849035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:30.849035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:30.849035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 432/877] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:30.853728 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009445e2-6610-4e91-8501-9f7517b87dfb None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:30.947390 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:30.960510 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009445e2-6610-4e91-8501-9f7517b87dfb None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:30.999283 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361d213-013b-4c79-89ca-ac5558ea3872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:30.999902 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361d213-013b-4c79-89ca-ac5558ea3872 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:31.000177 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361d213-013b-4c79-89ca-ac5558ea3872 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:31.000447 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361d213-013b-4c79-89ca-ac5558ea3872 None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:31.001094 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361d213-013b-4c79-89ca-ac5558ea3872 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:31.001400 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361d213-013b-4c79-89ca-ac5558ea3872 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:31.002797 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361d213-013b-4c79-89ca-ac5558ea3872 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:31.015732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 446/878] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:31.021661 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8154ae3-bbdf-487e-93cf-44e55555f65c None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:31.127038 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8154ae3-bbdf-487e-93cf-44e55555f65c None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:31.161908 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0fde7-464f-4d4a-99c2-36a4c1481c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:31.162552 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0fde7-464f-4d4a-99c2-36a4c1481c54 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:31.162826 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0fde7-464f-4d4a-99c2-36a4c1481c54 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:31.163094 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0fde7-464f-4d4a-99c2-36a4c1481c54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:31.170386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0fde7-464f-4d4a-99c2-36a4c1481c54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:31.171816 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0fde7-464f-4d4a-99c2-36a4c1481c54 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-8ce0fde7-464f-4d4a-99c2-36a4c1481c54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:26:31.183363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:31.184355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:31.185571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:26:31.185571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:26:31.185571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:26:31.185571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:26:31.185571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:26:31.185571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:26:31.185571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:31.185571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:31.185571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 433/879] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:26:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:31.192320 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361d213-013b-4c79-89ca-ac5558ea3872 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:31.315748 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361d213-013b-4c79-89ca-ac5558ea3872 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:31.352795 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a9695-4ca0-461f-9bc4-3912605e805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:31.353409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9695-4ca0-461f-9bc4-3912605e805e None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:31.353807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9695-4ca0-461f-9bc4-3912605e805e None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:31.354357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9695-4ca0-461f-9bc4-3912605e805e None admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:31.355134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a9695-4ca0-461f-9bc4-3912605e805e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:31.355438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a9695-4ca0-461f-9bc4-3912605e805e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:31.356892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a9695-4ca0-461f-9bc4-3912605e805e None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:31.370054 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 447/880] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:26:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:31.379953 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0fde7-464f-4d4a-99c2-36a4c1481c54 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:31.412624 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:31.498700 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0fde7-464f-4d4a-99c2-36a4c1481c54 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:31.536137 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76b323-38d4-473a-83ee-49efe2d81a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:31.536732 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b323-38d4-473a-83ee-49efe2d81a4e None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:31.537009 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b323-38d4-473a-83ee-49efe2d81a4e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:31.537275 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b323-38d4-473a-83ee-49efe2d81a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:31.538021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76b323-38d4-473a-83ee-49efe2d81a4e None admin] RBAC: Adding query filter params (role.id=4ef4b944934e44a28a394ebd1a816f64, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=35957952c2a142ba868279f19ab4d46d) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:31.538349 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76b323-38d4-473a-83ee-49efe2d81a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:31.540151 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76b323-38d4-473a-83ee-49efe2d81a4e None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:31.546269 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 434/881] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:26:31 2022] GET /identity/v3/role_assignments?user.id=35957952c2a142ba868279f19ab4d46d&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:33.683081 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cfa1-8742-41c6-94c0-fc4b7cc84405 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:33.683695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cfa1-8742-41c6-94c0-fc4b7cc84405 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:33.683695 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cfa1-8742-41c6-94c0-fc4b7cc84405 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:33.685011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 448/882] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:33.691685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d62e4e-7890-4799-9a5d-f825d044a994 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:33.692445 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d62e4e-7890-4799-9a5d-f825d044a994 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:33.692595 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d62e4e-7890-4799-9a5d-f825d044a994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:33.721872 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-f5d62e4e-7890-4799-9a5d-f825d044a994 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:33.723406 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-f5d62e4e-7890-4799-9a5d-f825d044a994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:33.804574 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 435/883] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:26:33 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:26:34.128989 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6cfa1-8742-41c6-94c0-fc4b7cc84405 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:34.141970 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:34.241307 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6cfa1-8742-41c6-94c0-fc4b7cc84405 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:34.276165 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d871695-bf71-44c8-a8fd-573d49f93140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:34.276788 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d871695-bf71-44c8-a8fd-573d49f93140 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:34.277061 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d871695-bf71-44c8-a8fd-573d49f93140 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:34.277326 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d871695-bf71-44c8-a8fd-573d49f93140 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:34.288060 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d871695-bf71-44c8-a8fd-573d49f93140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-5d871695-bf71-44c8-a8fd-573d49f93140 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:26:34.293100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:34.294176 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:34.295247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 449/884] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:34.301124 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d62e4e-7890-4799-9a5d-f825d044a994 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:34.320611 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:34.415890 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d62e4e-7890-4799-9a5d-f825d044a994 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:34.453983 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45b361-04d9-4d7f-b904-cba5a8ab32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:34.454619 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45b361-04d9-4d7f-b904-cba5a8ab32ca None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:34.454895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45b361-04d9-4d7f-b904-cba5a8ab32ca None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:34.455162 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45b361-04d9-4d7f-b904-cba5a8ab32ca None admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:34.455843 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45b361-04d9-4d7f-b904-cba5a8ab32ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:34.456143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45b361-04d9-4d7f-b904-cba5a8ab32ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:34.457524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45b361-04d9-4d7f-b904-cba5a8ab32ca None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:34.465725 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 436/885] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:34.474637 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d871695-bf71-44c8-a8fd-573d49f93140 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:34.558513 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:34.593198 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d871695-bf71-44c8-a8fd-573d49f93140 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:34.632673 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c75d4e-8ac7-45b0-9d03-49eb987422e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:34.633661 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c75d4e-8ac7-45b0-9d03-49eb987422e7 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:34.634069 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c75d4e-8ac7-45b0-9d03-49eb987422e7 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:34.634428 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c75d4e-8ac7-45b0-9d03-49eb987422e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:34.647801 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c75d4e-8ac7-45b0-9d03-49eb987422e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:34.649275 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c75d4e-8ac7-45b0-9d03-49eb987422e7 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-31c75d4e-8ac7-45b0-9d03-49eb987422e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:34.665785 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:34.666924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:34.668229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:34.668229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:34.668229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:34.668229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 450/886] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:34.673254 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45b361-04d9-4d7f-b904-cba5a8ab32ca None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:34.766301 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:34.790752 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45b361-04d9-4d7f-b904-cba5a8ab32ca None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:34.827596 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f95c96-3198-4ddb-b1ce-5b0540c7f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:34.828169 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95c96-3198-4ddb-b1ce-5b0540c7f878 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:34.828441 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95c96-3198-4ddb-b1ce-5b0540c7f878 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:34.828704 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95c96-3198-4ddb-b1ce-5b0540c7f878 None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:34.829328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f95c96-3198-4ddb-b1ce-5b0540c7f878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:34.829618 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f95c96-3198-4ddb-b1ce-5b0540c7f878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:34.831020 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f95c96-3198-4ddb-b1ce-5b0540c7f878 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:34.843318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 437/887] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:34.850287 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c75d4e-8ac7-45b0-9d03-49eb987422e7 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:34.960590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c75d4e-8ac7-45b0-9d03-49eb987422e7 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:34.981212 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:34.998934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3f547-105f-4b44-8ca3-5982d35764da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:34.999541 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3f547-105f-4b44-8ca3-5982d35764da None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:34.999820 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3f547-105f-4b44-8ca3-5982d35764da None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:35.000076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3f547-105f-4b44-8ca3-5982d35764da None admin] PATH_INFO: `/v3/users/placement` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:35.009507 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3f547-105f-4b44-8ca3-5982d35764da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:35.011000 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3f547-105f-4b44-8ca3-5982d35764da None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-79c3f547-105f-4b44-8ca3-5982d35764da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:26:35.023031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:35.024151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:35.026064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:35.026064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:35.026064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:26:35.026064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:26:35.026064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:26:35.026064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:26:35.026064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:26:35.026064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:26:35.026064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:35.026064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:35.026064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 451/888] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:35.033858 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f95c96-3198-4ddb-b1ce-5b0540c7f878 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:35.141740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f95c96-3198-4ddb-b1ce-5b0540c7f878 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:35.180005 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42e5ae-10c2-464f-b555-7991a92a3614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:35.180596 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42e5ae-10c2-464f-b555-7991a92a3614 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:35.180865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42e5ae-10c2-464f-b555-7991a92a3614 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:35.181139 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42e5ae-10c2-464f-b555-7991a92a3614 None admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:35.181847 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42e5ae-10c2-464f-b555-7991a92a3614 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:35.182178 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42e5ae-10c2-464f-b555-7991a92a3614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:35.183615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42e5ae-10c2-464f-b555-7991a92a3614 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:35.186306 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:35.203699 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 438/889] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 19:26:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:35.209797 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3f547-105f-4b44-8ca3-5982d35764da None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:35.316969 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3f547-105f-4b44-8ca3-5982d35764da None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:35.359981 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c32e7-2b1d-478d-a077-017fa7e67c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:35.360611 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c32e7-2b1d-478d-a077-017fa7e67c12 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:35.360892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c32e7-2b1d-478d-a077-017fa7e67c12 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:35.361157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c32e7-2b1d-478d-a077-017fa7e67c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:35.372531 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c32e7-2b1d-478d-a077-017fa7e67c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:35.374098 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c32e7-2b1d-478d-a077-017fa7e67c12 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-7b3c32e7-2b1d-478d-a077-017fa7e67c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:35.390319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:35.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:35.392692 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:35.392692 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:35.392692 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:35.392692 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 452/890] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:35.399769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42e5ae-10c2-464f-b555-7991a92a3614 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:35.517131 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42e5ae-10c2-464f-b555-7991a92a3614 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:35.556078 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb36a8-c721-44a8-bb07-b02c5bc051b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:35.556664 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb36a8-c721-44a8-bb07-b02c5bc051b9 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:35.556928 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb36a8-c721-44a8-bb07-b02c5bc051b9 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:35.557194 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb36a8-c721-44a8-bb07-b02c5bc051b9 None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:35.557810 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb36a8-c721-44a8-bb07-b02c5bc051b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:35.558128 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb36a8-c721-44a8-bb07-b02c5bc051b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:35.559490 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb36a8-c721-44a8-bb07-b02c5bc051b9 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:35.570793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 439/891] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:35.576993 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c32e7-2b1d-478d-a077-017fa7e67c12 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:35.611468 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:35.692925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c32e7-2b1d-478d-a077-017fa7e67c12 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:35.730989 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33986325-79f0-4925-b06d-7550745f2cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:35.731933 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33986325-79f0-4925-b06d-7550745f2cc3 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:35.732493 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33986325-79f0-4925-b06d-7550745f2cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:35.732843 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33986325-79f0-4925-b06d-7550745f2cc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:35.741900 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33986325-79f0-4925-b06d-7550745f2cc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:35.743408 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33986325-79f0-4925-b06d-7550745f2cc3 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-33986325-79f0-4925-b06d-7550745f2cc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:26:35.755119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:35.756183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:35.757155 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:26:35.757155 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:26:35.757155 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:26:35.757155 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:26:35.757155 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:26:35.757155 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:26:35.757155 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:35.757155 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:35.757155 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 453/892] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:26:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:26:35.762670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb36a8-c721-44a8-bb07-b02c5bc051b9 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:35.821218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:35.867884 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb36a8-c721-44a8-bb07-b02c5bc051b9 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:35.906540 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95cada-6d78-4104-8822-2687d1072e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:35.907127 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95cada-6d78-4104-8822-2687d1072e33 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:35.907402 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95cada-6d78-4104-8822-2687d1072e33 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:35.907668 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95cada-6d78-4104-8822-2687d1072e33 None admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:35.908346 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95cada-6d78-4104-8822-2687d1072e33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:35.908650 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95cada-6d78-4104-8822-2687d1072e33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:35.910100 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95cada-6d78-4104-8822-2687d1072e33 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:35.922586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 440/893] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:26:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:35.929068 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33986325-79f0-4925-b06d-7550745f2cc3 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:36.028292 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:36.037659 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33986325-79f0-4925-b06d-7550745f2cc3 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:36.072870 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f3931-3c77-44c3-8e01-abc2acd86d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:36.073456 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f3931-3c77-44c3-8e01-abc2acd86d48 None admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:36.073735 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f3931-3c77-44c3-8e01-abc2acd86d48 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:36.074040 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f3931-3c77-44c3-8e01-abc2acd86d48 None admin] PATH_INFO: `/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/35957952c2a142ba868279f19ab4d46d/roles/4ef4b944934e44a28a394ebd1a816f64` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:36.077223 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f3931-3c77-44c3-8e01-abc2acd86d48 None admin] RBAC: Authorizing `identity:create_grant(project_id=a186fc1651b442d4b704b88a3dddf1b0, user_id=35957952c2a142ba868279f19ab4d46d, role_id=4ef4b944934e44a28a394ebd1a816f64)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:36.078718 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f3931-3c77-44c3-8e01-abc2acd86d48 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:36.093957 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 454/894] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 19:26:35 2022] PUT /identity/v3/projects/a186fc1651b442d4b704b88a3dddf1b0/users/35957952c2a142ba868279f19ab4d46d/roles/4ef4b944934e44a28a394ebd1a816f64 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:26:38.272573 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d3234-d686-45fe-be3f-440ea0dd36a2 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:38.273470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d3234-d686-45fe-be3f-440ea0dd36a2 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:38.273470 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d3234-d686-45fe-be3f-440ea0dd36a2 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:38.275628 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 441/895] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:26:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:38.282414 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b567fa4-a87a-41a8-bb4d-2571e7bf31fa None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:38.282843 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b567fa4-a87a-41a8-bb4d-2571e7bf31fa None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:38.282977 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b567fa4-a87a-41a8-bb4d-2571e7bf31fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:38.313368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-1b567fa4-a87a-41a8-bb4d-2571e7bf31fa None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:38.314630 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-1b567fa4-a87a-41a8-bb4d-2571e7bf31fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:38.387025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 455/896] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:26:38 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:26:38.720981 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d3234-d686-45fe-be3f-440ea0dd36a2 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:38.843931 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d3234-d686-45fe-be3f-440ea0dd36a2 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:38.858042 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:38.879795 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9641ce-4031-43b7-80d3-a333aa0d3f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:38.880418 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9641ce-4031-43b7-80d3-a333aa0d3f0e None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:38.880691 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9641ce-4031-43b7-80d3-a333aa0d3f0e None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:38.880959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9641ce-4031-43b7-80d3-a333aa0d3f0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:38.891806 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9641ce-4031-43b7-80d3-a333aa0d3f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-6a9641ce-4031-43b7-80d3-a333aa0d3f0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:26:38.896525 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:38.897568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:38.898589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 442/897] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 19:26:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:38.904087 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b567fa4-a87a-41a8-bb4d-2571e7bf31fa None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:38.998833 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:39.018262 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b567fa4-a87a-41a8-bb4d-2571e7bf31fa None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:39.055267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77cb24-f3c8-47d8-bf0a-af458a9ad72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:39.055882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77cb24-f3c8-47d8-bf0a-af458a9ad72f None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:39.056156 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77cb24-f3c8-47d8-bf0a-af458a9ad72f None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:39.056430 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77cb24-f3c8-47d8-bf0a-af458a9ad72f None admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:39.057091 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77cb24-f3c8-47d8-bf0a-af458a9ad72f None admin] RBAC: Adding query filter params (name=admin) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:39.057402 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77cb24-f3c8-47d8-bf0a-af458a9ad72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:39.058807 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77cb24-f3c8-47d8-bf0a-af458a9ad72f None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:39.068089 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 456/898] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 19:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:39.074972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9641ce-4031-43b7-80d3-a333aa0d3f0e None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:39.202631 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9641ce-4031-43b7-80d3-a333aa0d3f0e None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:39.240785 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f8583-28ad-40b3-bc0f-50f79cf4cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:39.241681 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f8583-28ad-40b3-bc0f-50f79cf4cd31 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:39.242051 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f8583-28ad-40b3-bc0f-50f79cf4cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:39.242338 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f8583-28ad-40b3-bc0f-50f79cf4cd31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:39.260063 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f8583-28ad-40b3-bc0f-50f79cf4cd31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:39.262153 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f8583-28ad-40b3-bc0f-50f79cf4cd31 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-057f8583-28ad-40b3-bc0f-50f79cf4cd31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:39.277112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:39.278697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:39.279634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:39.279634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:39.279634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:39.279634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 443/899] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:39.284622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77cb24-f3c8-47d8-bf0a-af458a9ad72f None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:39.392297 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77cb24-f3c8-47d8-bf0a-af458a9ad72f None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:39.430236 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d519d-9729-4cd5-9da2-0c24d90a287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:39.430835 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d519d-9729-4cd5-9da2-0c24d90a287d None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:39.431102 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d519d-9729-4cd5-9da2-0c24d90a287d None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:39.431375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d519d-9729-4cd5-9da2-0c24d90a287d None admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:39.431998 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d519d-9729-4cd5-9da2-0c24d90a287d None admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:39.432297 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d519d-9729-4cd5-9da2-0c24d90a287d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:39.433657 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d519d-9729-4cd5-9da2-0c24d90a287d None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:39.445282 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 457/900] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:39.451293 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f8583-28ad-40b3-bc0f-50f79cf4cd31 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:39.481441 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:39.577211 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f8583-28ad-40b3-bc0f-50f79cf4cd31 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:39.616741 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ed6ad-a026-4d68-b4c1-b3f69b4149c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:39.617356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed6ad-a026-4d68-b4c1-b3f69b4149c0 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:39.617635 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed6ad-a026-4d68-b4c1-b3f69b4149c0 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:39.617906 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed6ad-a026-4d68-b4c1-b3f69b4149c0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:39.626489 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ed6ad-a026-4d68-b4c1-b3f69b4149c0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:39.627937 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ed6ad-a026-4d68-b4c1-b3f69b4149c0 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-0c6ed6ad-a026-4d68-b4c1-b3f69b4149c0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:26:39.639577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:39.640662 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:39.642054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:39.642054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:39.642054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:26:39.642054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:26:39.642054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:26:39.642054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:26:39.642054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:26:39.642054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:26:39.642054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:26:39.642054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:39.642054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 444/901] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:39.647413 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d519d-9729-4cd5-9da2-0c24d90a287d None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:39.654082 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:39.766786 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d519d-9729-4cd5-9da2-0c24d90a287d None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:39.803449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3092a2-53f2-49f2-9011-492535e148c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:39.804054 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3092a2-53f2-49f2-9011-492535e148c0 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:39.804329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3092a2-53f2-49f2-9011-492535e148c0 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:39.804596 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3092a2-53f2-49f2-9011-492535e148c0 None admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:39.805319 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3092a2-53f2-49f2-9011-492535e148c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:39.805623 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3092a2-53f2-49f2-9011-492535e148c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:39.807096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3092a2-53f2-49f2-9011-492535e148c0 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:39.824570 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 458/902] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 19:26:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:39.834172 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ed6ad-a026-4d68-b4c1-b3f69b4149c0 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:39.925910 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:39.944153 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ed6ad-a026-4d68-b4c1-b3f69b4149c0 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:39.979104 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f93b-540b-4cde-a796-ffb4a2999693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:39.979689 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f93b-540b-4cde-a796-ffb4a2999693 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:39.979959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f93b-540b-4cde-a796-ffb4a2999693 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:39.980216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f93b-540b-4cde-a796-ffb4a2999693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:40.058879 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f93b-540b-4cde-a796-ffb4a2999693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:40.060343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f93b-540b-4cde-a796-ffb4a2999693 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:40.151817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:40.168401 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 445/903] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 19:26:39 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 19:26:40.175009 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3092a2-53f2-49f2-9011-492535e148c0 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:40.244566 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:40.301924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3092a2-53f2-49f2-9011-492535e148c0 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:40.343374 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24e279-032d-4bdf-aaa1-c3b8e23044f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:40.344004 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24e279-032d-4bdf-aaa1-c3b8e23044f4 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:40.344284 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24e279-032d-4bdf-aaa1-c3b8e23044f4 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:40.344558 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24e279-032d-4bdf-aaa1-c3b8e23044f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:40.360674 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24e279-032d-4bdf-aaa1-c3b8e23044f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:40.362820 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24e279-032d-4bdf-aaa1-c3b8e23044f4 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-4e24e279-032d-4bdf-aaa1-c3b8e23044f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:26:40.381915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:40.383134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:26:40.384394 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:26:40.384394 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:26:40.384394 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:40.384394 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 459/904] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:40.389842 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f93b-540b-4cde-a796-ffb4a2999693 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:40.514636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f93b-540b-4cde-a796-ffb4a2999693 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:40.563219 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefece8-300c-4246-82a6-3df04c5d60ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:40.563820 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefece8-300c-4246-82a6-3df04c5d60ef None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:40.564091 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefece8-300c-4246-82a6-3df04c5d60ef None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:40.564352 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefece8-300c-4246-82a6-3df04c5d60ef None admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:40.564982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefece8-300c-4246-82a6-3df04c5d60ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:40.565281 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefece8-300c-4246-82a6-3df04c5d60ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:40.566681 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefece8-300c-4246-82a6-3df04c5d60ef None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:40.578798 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 446/905] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 19:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:40.587470 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24e279-032d-4bdf-aaa1-c3b8e23044f4 None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:40.693178 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24e279-032d-4bdf-aaa1-c3b8e23044f4 None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:40.707767 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:40.729010 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57291b51-57ad-40cd-afb5-2d02192fa3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:40.729636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57291b51-57ad-40cd-afb5-2d02192fa3da None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:40.729913 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57291b51-57ad-40cd-afb5-2d02192fa3da None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:40.730211 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57291b51-57ad-40cd-afb5-2d02192fa3da None admin] PATH_INFO: `/v3/projects/service` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:40.737764 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57291b51-57ad-40cd-afb5-2d02192fa3da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:40.739240 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57291b51-57ad-40cd-afb5-2d02192fa3da None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application [None req-57291b51-57ad-40cd-afb5-2d02192fa3da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:26:40.755302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:40.757011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:40.758588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:26:40.758588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:26:40.758588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:26:40.758588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:26:40.758588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:26:40.758588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:26:40.758588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:26:40.758588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: ERROR keystone.server.flask.application Aug 19 19:26:40.758588 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 460/906] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 19:26:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:40.764589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefece8-300c-4246-82a6-3df04c5d60ef None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:40.817398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:40.880171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefece8-300c-4246-82a6-3df04c5d60ef None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:40.915955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe110b0a-1d7b-4103-94cb-e982537da062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:40.916557 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe110b0a-1d7b-4103-94cb-e982537da062 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:40.916830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe110b0a-1d7b-4103-94cb-e982537da062 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:40.917095 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe110b0a-1d7b-4103-94cb-e982537da062 None admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:40.917770 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe110b0a-1d7b-4103-94cb-e982537da062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:40.918078 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe110b0a-1d7b-4103-94cb-e982537da062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:40.919542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe110b0a-1d7b-4103-94cb-e982537da062 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:40.931784 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 447/907] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 19:26:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:26:40.938563 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57291b51-57ad-40cd-afb5-2d02192fa3da None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:41.047869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57291b51-57ad-40cd-afb5-2d02192fa3da None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:41.090945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fff44-10e4-40db-81f4-72108d313111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:41.091556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fff44-10e4-40db-81f4-72108d313111 None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:41.092034 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fff44-10e4-40db-81f4-72108d313111 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:41.092307 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fff44-10e4-40db-81f4-72108d313111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:41.093033 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fff44-10e4-40db-81f4-72108d313111 None admin] RBAC: Adding query filter params (role.id=4ef4b944934e44a28a394ebd1a816f64, scope.project.id=a186fc1651b442d4b704b88a3dddf1b0, user.id=35957952c2a142ba868279f19ab4d46d) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:41.093347 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fff44-10e4-40db-81f4-72108d313111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:41.094821 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fff44-10e4-40db-81f4-72108d313111 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:41.102023 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 461/908] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 19:26:40 2022] GET /identity/v3/role_assignments?user.id=35957952c2a142ba868279f19ab4d46d&scope.project.id=a186fc1651b442d4b704b88a3dddf1b0&role.id=4ef4b944934e44a28a394ebd1a816f64 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:43.323520 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05849bf-8075-4acc-b7a0-d90dba5f691e None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:43.324095 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05849bf-8075-4acc-b7a0-d90dba5f691e None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:43.324095 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05849bf-8075-4acc-b7a0-d90dba5f691e None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:43.326202 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 448/909] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:26:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:43.334904 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152301c-e2a2-48bd-a6c2-69a4490057d5 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:43.335681 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152301c-e2a2-48bd-a6c2-69a4490057d5 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:43.335837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152301c-e2a2-48bd-a6c2-69a4490057d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:43.358225 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-7152301c-e2a2-48bd-a6c2-69a4490057d5 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:43.359398 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-7152301c-e2a2-48bd-a6c2-69a4490057d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:43.394129 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:43.435264 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 462/910] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:26:43 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:26:43.763704 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05849bf-8075-4acc-b7a0-d90dba5f691e None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:43.880511 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05849bf-8075-4acc-b7a0-d90dba5f691e None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:43.888271 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:43.919404 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b773c-f52d-4619-98ce-203e6f6842f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:43.920068 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b773c-f52d-4619-98ce-203e6f6842f9 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:43.920398 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b773c-f52d-4619-98ce-203e6f6842f9 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:43.920572 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b773c-f52d-4619-98ce-203e6f6842f9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:43.921149 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b773c-f52d-4619-98ce-203e6f6842f9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:43.922579 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b773c-f52d-4619-98ce-203e6f6842f9 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-ac2b773c-f52d-4619-98ce-203e6f6842f9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:43.931860 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:43.933039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:43.933929 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 449/911] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Aug 19 19:26:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:26:43.941470 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152301c-e2a2-48bd-a6c2-69a4490057d5 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:44.062281 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152301c-e2a2-48bd-a6c2-69a4490057d5 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:44.097782 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c069a72-d22a-4ef9-8938-b13437db61cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:44.098415 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069a72-d22a-4ef9-8938-b13437db61cc None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:44.098689 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069a72-d22a-4ef9-8938-b13437db61cc None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:44.098953 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069a72-d22a-4ef9-8938-b13437db61cc None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:44.099565 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c069a72-d22a-4ef9-8938-b13437db61cc None admin] RBAC: Adding query filter params (name=placement) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:44.099859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c069a72-d22a-4ef9-8938-b13437db61cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:44.101219 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c069a72-d22a-4ef9-8938-b13437db61cc None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:44.106032 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 463/912] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Aug 19 19:26:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:44.114861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b773c-f52d-4619-98ce-203e6f6842f9 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:44.224941 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b773c-f52d-4619-98ce-203e6f6842f9 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:44.262428 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68a502-48a2-40ec-9794-ea0141caa09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:44.263007 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68a502-48a2-40ec-9794-ea0141caa09f None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:44.263276 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68a502-48a2-40ec-9794-ea0141caa09f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:44.263563 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68a502-48a2-40ec-9794-ea0141caa09f None admin] PATH_INFO: `/v3/services` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:44.264168 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68a502-48a2-40ec-9794-ea0141caa09f None admin] RBAC: Adding query filter params (type=placement) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:44.264457 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68a502-48a2-40ec-9794-ea0141caa09f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:44.265840 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68a502-48a2-40ec-9794-ea0141caa09f None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:44.270962 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 450/913] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Aug 19 19:26:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:26:46.419979 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b047df-caec-4978-8d52-d8b4172fab04 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:46.420819 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b047df-caec-4978-8d52-d8b4172fab04 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:46.420819 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b047df-caec-4978-8d52-d8b4172fab04 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:46.422996 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 464/914] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:26:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:46.431830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e81ad-d552-44f1-9beb-9d3a2b125229 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:46.432524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e81ad-d552-44f1-9beb-9d3a2b125229 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:46.432734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e81ad-d552-44f1-9beb-9d3a2b125229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:46.453048 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-995e81ad-d552-44f1-9beb-9d3a2b125229 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:46.454198 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-995e81ad-d552-44f1-9beb-9d3a2b125229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:46.481747 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:46.526585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 451/915] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:26:46 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:26:46.851880 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b047df-caec-4978-8d52-d8b4172fab04 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:46.889943 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:46.972787 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b047df-caec-4978-8d52-d8b4172fab04 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:47.009741 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bf99f-9ee5-4b64-9a1c-eab401ecfa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:47.010506 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bf99f-9ee5-4b64-9a1c-eab401ecfa16 None admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:47.010782 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bf99f-9ee5-4b64-9a1c-eab401ecfa16 None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:47.011079 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bf99f-9ee5-4b64-9a1c-eab401ecfa16 None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:47.011725 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bf99f-9ee5-4b64-9a1c-eab401ecfa16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:47.013117 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bf99f-9ee5-4b64-9a1c-eab401ecfa16 None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:47.032971 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 465/916] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 19:26:46 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:26:49.177895 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f33b-836e-4644-b6d6-55c6dc7477b7 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:49.178513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f33b-836e-4644-b6d6-55c6dc7477b7 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:49.178513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f33b-836e-4644-b6d6-55c6dc7477b7 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:49.179801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 452/917] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:49.186144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018e9bc-cc04-4123-bc01-7c11cdbc2ea1 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:49.186844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018e9bc-cc04-4123-bc01-7c11cdbc2ea1 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:49.186986 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018e9bc-cc04-4123-bc01-7c11cdbc2ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:49.207304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-d018e9bc-cc04-4123-bc01-7c11cdbc2ea1 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:49.208482 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-d018e9bc-cc04-4123-bc01-7c11cdbc2ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:49.299062 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 466/918] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:26:49 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:26:49.622031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34f33b-836e-4644-b6d6-55c6dc7477b7 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:49.740114 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34f33b-836e-4644-b6d6-55c6dc7477b7 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:49.781307 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9bda3-5e35-4599-8ae3-c6d82b36acb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:49.782107 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9bda3-5e35-4599-8ae3-c6d82b36acb5 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:49.782407 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9bda3-5e35-4599-8ae3-c6d82b36acb5 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:49.782793 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9bda3-5e35-4599-8ae3-c6d82b36acb5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:49.783401 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9bda3-5e35-4599-8ae3-c6d82b36acb5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:49.785203 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9bda3-5e35-4599-8ae3-c6d82b36acb5 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-a2d9bda3-5e35-4599-8ae3-c6d82b36acb5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:49.796335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:49.797499 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:49.798537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 453/919] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Aug 19 19:26:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:49.803922 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018e9bc-cc04-4123-bc01-7c11cdbc2ea1 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:49.824620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:49.911158 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018e9bc-cc04-4123-bc01-7c11cdbc2ea1 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:49.949914 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec53744-8d6e-41a0-9c28-ddcb3b09a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:49.950553 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53744-8d6e-41a0-9c28-ddcb3b09a56c None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:49.950982 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53744-8d6e-41a0-9c28-ddcb3b09a56c None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:49.951384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53744-8d6e-41a0-9c28-ddcb3b09a56c None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:49.952003 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec53744-8d6e-41a0-9c28-ddcb3b09a56c None admin] RBAC: Adding query filter params (name=placement) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:49.952302 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec53744-8d6e-41a0-9c28-ddcb3b09a56c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:49.953693 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec53744-8d6e-41a0-9c28-ddcb3b09a56c None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:49.958773 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 467/920] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Aug 19 19:26:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:49.965152 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9bda3-5e35-4599-8ae3-c6d82b36acb5 None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:49.999893 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:50.073623 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9bda3-5e35-4599-8ae3-c6d82b36acb5 None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:50.109832 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b74e1d-99d1-4b5e-a79c-e78a5804b579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:50.110811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b74e1d-99d1-4b5e-a79c-e78a5804b579 None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:50.111222 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b74e1d-99d1-4b5e-a79c-e78a5804b579 None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:50.111619 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b74e1d-99d1-4b5e-a79c-e78a5804b579 None admin] PATH_INFO: `/v3/endpoints` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:50.112763 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b74e1d-99d1-4b5e-a79c-e78a5804b579 None admin] RBAC: Adding query filter params (interface=public, service_id=06a670d273be47feaf66230ef57257b0, region_id=RegionOne) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:50.113201 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b74e1d-99d1-4b5e-a79c-e78a5804b579 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:50.115427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b74e1d-99d1-4b5e-a79c-e78a5804b579 None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:50.123565 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 454/921] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 19:26:49 2022] GET /identity/v3/endpoints?service_id=06a670d273be47feaf66230ef57257b0&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:50.130184 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec53744-8d6e-41a0-9c28-ddcb3b09a56c None admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:50.227616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:50.247584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec53744-8d6e-41a0-9c28-ddcb3b09a56c None admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:50.286133 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854e429-4529-4c5f-a5fa-8e9a6645b1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:50.286757 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e429-4529-4c5f-a5fa-8e9a6645b1ca None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:50.287025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e429-4529-4c5f-a5fa-8e9a6645b1ca None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:50.287288 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e429-4529-4c5f-a5fa-8e9a6645b1ca None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:50.287875 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854e429-4529-4c5f-a5fa-8e9a6645b1ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:50.289603 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854e429-4529-4c5f-a5fa-8e9a6645b1ca None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:50.296226 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 468/922] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 19:26:50 2022] GET /identity/v3/services => generated 1962 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:26:52.425500 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3db1-9473-4e83-a50f-941dc16ab48f None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:52.426449 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3db1-9473-4e83-a50f-941dc16ab48f None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:52.426449 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3db1-9473-4e83-a50f-941dc16ab48f None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:52.428544 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 455/923] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:26:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:52.433862 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdaad1-5a2a-4e5f-99dc-ea7ac2a7ae9a None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:52.434350 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdaad1-5a2a-4e5f-99dc-ea7ac2a7ae9a None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:52.434463 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdaad1-5a2a-4e5f-99dc-ea7ac2a7ae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:52.454183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-adcdaad1-5a2a-4e5f-99dc-ea7ac2a7ae9a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:52.455273 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-adcdaad1-5a2a-4e5f-99dc-ea7ac2a7ae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:52.527578 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 469/924] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:26:52 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:26:52.849446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b3db1-9473-4e83-a50f-941dc16ab48f None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:52.948859 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:52.959914 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b3db1-9473-4e83-a50f-941dc16ab48f None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:53.003435 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0c9b4-bf86-4f2e-98ca-c750f86d0b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:53.004066 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0c9b4-bf86-4f2e-98ca-c750f86d0b1f None admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:53.004328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0c9b4-bf86-4f2e-98ca-c750f86d0b1f None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:53.004593 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0c9b4-bf86-4f2e-98ca-c750f86d0b1f None admin] PATH_INFO: `/v3/services/placement` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:53.005170 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0c9b4-bf86-4f2e-98ca-c750f86d0b1f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:53.006571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0c9b4-bf86-4f2e-98ca-c750f86d0b1f None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application [None req-d0c0c9b4-bf86-4f2e-98ca-c750f86d0b1f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:26:53.020570 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:26:53.022235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application with Lock( Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: ERROR keystone.server.flask.application Aug 19 19:26:53.023713 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 456/925] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Aug 19 19:26:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:26:53.030711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdaad1-5a2a-4e5f-99dc-ea7ac2a7ae9a None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:53.109449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:53.134478 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdaad1-5a2a-4e5f-99dc-ea7ac2a7ae9a None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:53.170286 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f173b-3ac4-4b9d-9f0a-075dccafd1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:53.170887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f173b-3ac4-4b9d-9f0a-075dccafd1ad None admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:53.171153 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f173b-3ac4-4b9d-9f0a-075dccafd1ad None admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:53.171416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f173b-3ac4-4b9d-9f0a-075dccafd1ad None admin] PATH_INFO: `/v3/services` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:53.172031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f173b-3ac4-4b9d-9f0a-075dccafd1ad None admin] RBAC: Adding query filter params (name=placement) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:53.172320 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f173b-3ac4-4b9d-9f0a-075dccafd1ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:53.173702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f173b-3ac4-4b9d-9f0a-075dccafd1ad None admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:53.178827 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 470/926] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Aug 19 19:26:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:53.187587 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0c9b4-bf86-4f2e-98ca-c750f86d0b1f None admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:53.300006 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0c9b4-bf86-4f2e-98ca-c750f86d0b1f None admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:53.341272 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765971b5-c602-466b-a82b-b6cec825d61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:53.341868 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765971b5-c602-466b-a82b-b6cec825d61d None admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:53.342168 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765971b5-c602-466b-a82b-b6cec825d61d None admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:53.342485 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765971b5-c602-466b-a82b-b6cec825d61d None admin] PATH_INFO: `/v3/endpoints` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:53.343140 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765971b5-c602-466b-a82b-b6cec825d61d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:53.344526 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765971b5-c602-466b-a82b-b6cec825d61d None admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:53.365765 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 457/927] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:26:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:27:03.175787 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=30 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:27:03.361802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:27:54.683101 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cf54-0968-4d22-be1d-36077f443bd6 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:54.683618 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cf54-0968-4d22-be1d-36077f443bd6 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:54.683712 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cf54-0968-4d22-be1d-36077f443bd6 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:54.685201 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 471/928] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:27:54.690480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18790662-a0a3-40ef-bc5b-8de93badd1fb None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:54.690957 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18790662-a0a3-40ef-bc5b-8de93badd1fb None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:54.690957 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18790662-a0a3-40ef-bc5b-8de93badd1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:54.731101 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-18790662-a0a3-40ef-bc5b-8de93badd1fb None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:27:54.732331 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-18790662-a0a3-40ef-bc5b-8de93badd1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:27:54.829813 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 458/929] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:27:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:27:55.203195 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ebf25-afa0-4632-a196-a8835d508886 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:55.203711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ebf25-afa0-4632-a196-a8835d508886 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:55.204038 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ebf25-afa0-4632-a196-a8835d508886 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:55.205898 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 472/930] 10.222.0.60 () {54 vars in 965 bytes} [Fri Aug 19 19:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:27:55.212669 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c7c36-f41f-4f2b-8b84-7ced8171e0e6 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:55.212981 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c7c36-f41f-4f2b-8b84-7ced8171e0e6 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:55.213341 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c7c36-f41f-4f2b-8b84-7ced8171e0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:55.279187 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-3d5c7c36-f41f-4f2b-8b84-7ced8171e0e6 None None] MFA Rules not processed for user `3ba4a0ad60a549bd8255124ffcd83f30`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:27:55.280490 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-3d5c7c36-f41f-4f2b-8b84-7ced8171e0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:27:55.343000 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 459/931] 10.222.0.60 () {58 vars in 1062 bytes} [Fri Aug 19 19:27:55 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:27:55.352227 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ebf25-afa0-4632-a196-a8835d508886 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:27:55.363773 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ebf25-afa0-4632-a196-a8835d508886 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:27:55.367563 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7448e9-1112-4c35-87bd-6d19bae3552d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:27:55.368245 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7448e9-1112-4c35-87bd-6d19bae3552d service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:55.368576 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7448e9-1112-4c35-87bd-6d19bae3552d service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:55.368908 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7448e9-1112-4c35-87bd-6d19bae3552d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:55.379007 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7448e9-1112-4c35-87bd-6d19bae3552d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:27:55.380525 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7448e9-1112-4c35-87bd-6d19bae3552d service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:27:55.390513 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 473/932] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:27:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:27:57.833714 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2791cb-8148-4d7f-b369-b063f503a51d None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:57.834342 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2791cb-8148-4d7f-b369-b063f503a51d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:57.834342 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2791cb-8148-4d7f-b369-b063f503a51d None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:57.835817 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 460/933] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:27:57.840838 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026861a4-94c0-4d95-9c1f-905675c1185f None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:57.841269 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026861a4-94c0-4d95-9c1f-905675c1185f None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:57.841359 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026861a4-94c0-4d95-9c1f-905675c1185f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:57.861383 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-026861a4-94c0-4d95-9c1f-905675c1185f None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:27:57.862620 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-026861a4-94c0-4d95-9c1f-905675c1185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:27:57.871189 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 474/934] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:27:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:27:58.226324 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591c8b-1aee-42ec-997a-139bb30c3643 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:58.226750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591c8b-1aee-42ec-997a-139bb30c3643 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:58.226864 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591c8b-1aee-42ec-997a-139bb30c3643 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:58.228497 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 461/935] 10.222.0.60 () {54 vars in 965 bytes} [Fri Aug 19 19:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:27:58.235451 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a15a6d-b067-40dc-a3e3-6dcb58ae08bc None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:58.236095 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a15a6d-b067-40dc-a3e3-6dcb58ae08bc None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:58.236466 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a15a6d-b067-40dc-a3e3-6dcb58ae08bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:58.258189 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-60a15a6d-b067-40dc-a3e3-6dcb58ae08bc None None] MFA Rules not processed for user `3ba4a0ad60a549bd8255124ffcd83f30`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:27:58.259680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-60a15a6d-b067-40dc-a3e3-6dcb58ae08bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:27:58.267326 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 475/936] 10.222.0.60 () {58 vars in 1062 bytes} [Fri Aug 19 19:27:58 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:27:58.276375 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89591c8b-1aee-42ec-997a-139bb30c3643 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:27:58.288982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89591c8b-1aee-42ec-997a-139bb30c3643 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:27:58.292670 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c647a61-da87-4e21-af14-128e2010dcfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:27:58.293338 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647a61-da87-4e21-af14-128e2010dcfb service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:58.293679 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647a61-da87-4e21-af14-128e2010dcfb service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:58.294089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647a61-da87-4e21-af14-128e2010dcfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:58.303990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c647a61-da87-4e21-af14-128e2010dcfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:27:58.305486 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c647a61-da87-4e21-af14-128e2010dcfb service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:27:58.315641 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 462/937] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:27:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:01.033747 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ef8d6-ae2f-4896-8cb5-6b7c1c921268 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:01.034384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ef8d6-ae2f-4896-8cb5-6b7c1c921268 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:01.034384 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ef8d6-ae2f-4896-8cb5-6b7c1c921268 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:01.035731 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 476/938] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:01.042413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed537-ddfb-4e5f-b087-eacc93a8c679 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:01.042984 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed537-ddfb-4e5f-b087-eacc93a8c679 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:01.042984 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed537-ddfb-4e5f-b087-eacc93a8c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:01.083535 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-8c1ed537-ddfb-4e5f-b087-eacc93a8c679 None None] MFA Rules not processed for user `34cb0c8fda3c4c3db8e786e2db0c16cc`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:01.084728 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-8c1ed537-ddfb-4e5f-b087-eacc93a8c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:01.133703 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:28:01.162161 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 463/939] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:01 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:01.513467 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ef8d6-ae2f-4896-8cb5-6b7c1c921268 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:01.525959 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ef8d6-ae2f-4896-8cb5-6b7c1c921268 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:01.529804 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca867b-980c-408f-a0cb-aa488a246e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:01.530573 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca867b-980c-408f-a0cb-aa488a246e65 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:01.530989 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca867b-980c-408f-a0cb-aa488a246e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:01.531267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca867b-980c-408f-a0cb-aa488a246e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:01.542181 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca867b-980c-408f-a0cb-aa488a246e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:01.543664 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca867b-980c-408f-a0cb-aa488a246e65 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:01.555685 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 477/940] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:01 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:04.509487 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e272c-d969-40bc-a459-ca3d5e87403a None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:04.510070 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e272c-d969-40bc-a459-ca3d5e87403a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:04.510070 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e272c-d969-40bc-a459-ca3d5e87403a None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:04.511313 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 464/941] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:04.518254 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db335e-8261-4648-b45f-fa42b46d365f None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:04.518952 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db335e-8261-4648-b45f-fa42b46d365f None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:04.519134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db335e-8261-4648-b45f-fa42b46d365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:04.550325 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-c4db335e-8261-4648-b45f-fa42b46d365f None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:04.551537 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-c4db335e-8261-4648-b45f-fa42b46d365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:04.639202 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 478/942] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:04 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:04.988912 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e272c-d969-40bc-a459-ca3d5e87403a None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:05.001129 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e272c-d969-40bc-a459-ca3d5e87403a None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:05.004972 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e963c3-d174-4bb9-915d-a042df49e394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:05.005556 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e963c3-d174-4bb9-915d-a042df49e394 service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:05.005828 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e963c3-d174-4bb9-915d-a042df49e394 service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:05.006128 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e963c3-d174-4bb9-915d-a042df49e394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:05.015479 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e963c3-d174-4bb9-915d-a042df49e394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:05.016905 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e963c3-d174-4bb9-915d-a042df49e394 service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:05.026357 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 465/943] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:04 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:07.941727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cbda-59ee-40ad-82a3-17b4a5a93d86 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:07.942226 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cbda-59ee-40ad-82a3-17b4a5a93d86 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:07.942393 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cbda-59ee-40ad-82a3-17b4a5a93d86 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:07.944749 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 479/944] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:07.949204 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403550-e560-4d12-9e1b-6a39a8368b87 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:07.949652 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403550-e560-4d12-9e1b-6a39a8368b87 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:07.949776 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403550-e560-4d12-9e1b-6a39a8368b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:07.970495 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-bd403550-e560-4d12-9e1b-6a39a8368b87 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:07.971712 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-bd403550-e560-4d12-9e1b-6a39a8368b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:07.980887 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 466/945] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:08.322443 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0cbda-59ee-40ad-82a3-17b4a5a93d86 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:08.335014 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0cbda-59ee-40ad-82a3-17b4a5a93d86 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:08.338874 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b148b-8832-493c-8d0b-cf4a5cbfe113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:08.339469 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b148b-8832-493c-8d0b-cf4a5cbfe113 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:08.339740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b148b-8832-493c-8d0b-cf4a5cbfe113 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:08.340010 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b148b-8832-493c-8d0b-cf4a5cbfe113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:08.349666 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b148b-8832-493c-8d0b-cf4a5cbfe113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:08.351136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b148b-8832-493c-8d0b-cf4a5cbfe113 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:08.360702 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 480/946] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:10.643767 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec3511-6b7b-4a03-9d68-9fa76d457e28 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:10.644369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec3511-6b7b-4a03-9d68-9fa76d457e28 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:10.644369 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec3511-6b7b-4a03-9d68-9fa76d457e28 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:10.645708 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 467/947] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:28:10.653100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1c4b8-bfcc-4ca0-b8f2-398c3c445180 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:10.653633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1c4b8-bfcc-4ca0-b8f2-398c3c445180 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:10.653633 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1c4b8-bfcc-4ca0-b8f2-398c3c445180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:10.677441 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-6da1c4b8-bfcc-4ca0-b8f2-398c3c445180 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:10.679132 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-6da1c4b8-bfcc-4ca0-b8f2-398c3c445180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:10.687847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 481/948] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:11.049935 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec3511-6b7b-4a03-9d68-9fa76d457e28 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:11.062760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec3511-6b7b-4a03-9d68-9fa76d457e28 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:11.066631 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda0674-e193-43b0-b78f-f330be17058a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:11.067236 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0674-e193-43b0-b78f-f330be17058a service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:11.067509 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0674-e193-43b0-b78f-f330be17058a service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:11.067775 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0674-e193-43b0-b78f-f330be17058a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:11.082745 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda0674-e193-43b0-b78f-f330be17058a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:11.084181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda0674-e193-43b0-b78f-f330be17058a service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:11.097803 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 468/949] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:13.343723 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727fb6-edae-4f28-b6a7-eb534fbbe481 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:13.344244 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727fb6-edae-4f28-b6a7-eb534fbbe481 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:13.344244 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727fb6-edae-4f28-b6a7-eb534fbbe481 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:13.345611 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 482/950] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:13.351051 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5e726-b6d7-4a05-94a2-cff2cc0f9aae None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:13.351550 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5e726-b6d7-4a05-94a2-cff2cc0f9aae None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:13.351550 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5e726-b6d7-4a05-94a2-cff2cc0f9aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:13.371512 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-2ac5e726-b6d7-4a05-94a2-cff2cc0f9aae None None] MFA Rules not processed for user `34cb0c8fda3c4c3db8e786e2db0c16cc`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:13.372808 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-2ac5e726-b6d7-4a05-94a2-cff2cc0f9aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:13.380710 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 469/951] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:13 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:13.714648 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29727fb6-edae-4f28-b6a7-eb534fbbe481 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:13.726400 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29727fb6-edae-4f28-b6a7-eb534fbbe481 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:13.730278 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb745a7-1286-4e15-af93-ca839de29306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:13.730874 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb745a7-1286-4e15-af93-ca839de29306 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:13.731151 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb745a7-1286-4e15-af93-ca839de29306 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:13.731421 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb745a7-1286-4e15-af93-ca839de29306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:13.741125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb745a7-1286-4e15-af93-ca839de29306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:13.742595 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb745a7-1286-4e15-af93-ca839de29306 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:13.752436 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 483/952] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:13 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:16.212167 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1e1da-257e-413f-9bbe-b95a0d93b5da None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:16.212730 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1e1da-257e-413f-9bbe-b95a0d93b5da None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:16.212730 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1e1da-257e-413f-9bbe-b95a0d93b5da None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:16.214147 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 470/953] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:16.219663 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f255-b7d7-437c-9516-a44979ac0963 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:16.220127 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f255-b7d7-437c-9516-a44979ac0963 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:16.220220 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f255-b7d7-437c-9516-a44979ac0963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:16.241144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-1281f255-b7d7-437c-9516-a44979ac0963 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:16.242370 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-1281f255-b7d7-437c-9516-a44979ac0963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:16.251826 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 484/954] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:16.584182 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1e1da-257e-413f-9bbe-b95a0d93b5da None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:16.595656 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1e1da-257e-413f-9bbe-b95a0d93b5da None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:16.599569 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302f0ce-eeda-4f42-af10-37bebce10faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:16.600159 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f0ce-eeda-4f42-af10-37bebce10faf service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:16.600432 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f0ce-eeda-4f42-af10-37bebce10faf service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:16.600696 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f0ce-eeda-4f42-af10-37bebce10faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:16.609975 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302f0ce-eeda-4f42-af10-37bebce10faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:16.611438 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302f0ce-eeda-4f42-af10-37bebce10faf service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:16.621131 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 471/955] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:18.893289 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013ef1-ab2b-4062-8cf2-7233c6c631a0 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:18.893890 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013ef1-ab2b-4062-8cf2-7233c6c631a0 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:18.893890 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013ef1-ab2b-4062-8cf2-7233c6c631a0 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:18.895150 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 485/956] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:28:18.900501 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8f44-eab0-430e-85f2-43c534427dcb None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:18.900933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8f44-eab0-430e-85f2-43c534427dcb None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:18.901030 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8f44-eab0-430e-85f2-43c534427dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:18.921344 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-432c8f44-eab0-430e-85f2-43c534427dcb None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:18.923055 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-432c8f44-eab0-430e-85f2-43c534427dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:18.932443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 472/957] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:28:19.269698 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45013ef1-ab2b-4062-8cf2-7233c6c631a0 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:19.283790 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45013ef1-ab2b-4062-8cf2-7233c6c631a0 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:19.287984 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72066a8d-e57a-4ab7-bead-7e31c003539c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:19.288862 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066a8d-e57a-4ab7-bead-7e31c003539c service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:19.289965 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066a8d-e57a-4ab7-bead-7e31c003539c service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:19.290283 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066a8d-e57a-4ab7-bead-7e31c003539c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:19.301477 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72066a8d-e57a-4ab7-bead-7e31c003539c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:19.303573 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72066a8d-e57a-4ab7-bead-7e31c003539c service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:19.314304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 486/958] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:21.994258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f448e-fc17-47e8-a743-d935ba287e38 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:21.994799 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f448e-fc17-47e8-a743-d935ba287e38 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:21.994799 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f448e-fc17-47e8-a743-d935ba287e38 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:21.996123 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 473/959] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:22.001631 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8817-e089-4ee9-a35d-b4fd7a208e83 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:22.002143 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8817-e089-4ee9-a35d-b4fd7a208e83 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:22.002232 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8817-e089-4ee9-a35d-b4fd7a208e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:22.023225 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-4c2b8817-e089-4ee9-a35d-b4fd7a208e83 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:22.024425 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-4c2b8817-e089-4ee9-a35d-b4fd7a208e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:22.035327 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 487/960] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:22 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:22.366838 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f448e-fc17-47e8-a743-d935ba287e38 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:22.381355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f448e-fc17-47e8-a743-d935ba287e38 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:22.385759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38813a-523d-4be3-9f77-b7eb007d2720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:22.386366 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38813a-523d-4be3-9f77-b7eb007d2720 service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:22.386633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38813a-523d-4be3-9f77-b7eb007d2720 service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:22.386897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38813a-523d-4be3-9f77-b7eb007d2720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:22.396681 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38813a-523d-4be3-9f77-b7eb007d2720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:22.398133 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38813a-523d-4be3-9f77-b7eb007d2720 service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:22.407669 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 474/961] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:22 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:26.623985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8b796-c73e-41bf-b35e-9474cac69e8a None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:26.624577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8b796-c73e-41bf-b35e-9474cac69e8a None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:26.624577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8b796-c73e-41bf-b35e-9474cac69e8a None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:26.625733 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 488/962] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:26.631154 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fb422-fb60-4db4-bd29-ea9fe25d14ff None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:26.631587 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fb422-fb60-4db4-bd29-ea9fe25d14ff None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:26.631714 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fb422-fb60-4db4-bd29-ea9fe25d14ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:26.651795 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-b25fb422-fb60-4db4-bd29-ea9fe25d14ff None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:26.653008 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-b25fb422-fb60-4db4-bd29-ea9fe25d14ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:26.661181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 475/963] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:27.003006 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8b796-c73e-41bf-b35e-9474cac69e8a None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:27.009070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=77 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:28:27.016231 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8b796-c73e-41bf-b35e-9474cac69e8a None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:27.020242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e9f6f-ca02-4cdd-8862-34b200c2450b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:27.020853 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9f6f-ca02-4cdd-8862-34b200c2450b service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:27.021134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9f6f-ca02-4cdd-8862-34b200c2450b service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:27.021400 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9f6f-ca02-4cdd-8862-34b200c2450b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:27.031412 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e9f6f-ca02-4cdd-8862-34b200c2450b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:27.032836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e9f6f-ca02-4cdd-8862-34b200c2450b service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:27.042834 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 489/964] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:29.962559 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20d317-b33f-44c1-8fee-f6e99ab61da8 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:29.963024 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20d317-b33f-44c1-8fee-f6e99ab61da8 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:29.963105 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20d317-b33f-44c1-8fee-f6e99ab61da8 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:29.964427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 476/965] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:29.969804 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a0233-6938-401b-b6f0-8d3ac177807f None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:29.970277 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a0233-6938-401b-b6f0-8d3ac177807f None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:29.970369 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a0233-6938-401b-b6f0-8d3ac177807f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:29.990425 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-ae3a0233-6938-401b-b6f0-8d3ac177807f None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:29.991632 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-ae3a0233-6938-401b-b6f0-8d3ac177807f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:30.000035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 490/966] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:29 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:30.352584 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20d317-b33f-44c1-8fee-f6e99ab61da8 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:30.364588 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20d317-b33f-44c1-8fee-f6e99ab61da8 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:30.368876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac966f-0a5b-45f5-989b-d78e4725ade7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:30.369484 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac966f-0a5b-45f5-989b-d78e4725ade7 service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:30.369751 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac966f-0a5b-45f5-989b-d78e4725ade7 service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:30.370047 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac966f-0a5b-45f5-989b-d78e4725ade7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:30.380145 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac966f-0a5b-45f5-989b-d78e4725ade7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:30.381575 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac966f-0a5b-45f5-989b-d78e4725ade7 service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:30.391409 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 477/967] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:30 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:34.779787 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4ba15-9a54-487c-8806-58aeb3f497e4 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:34.780714 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4ba15-9a54-487c-8806-58aeb3f497e4 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:34.781197 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4ba15-9a54-487c-8806-58aeb3f497e4 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:34.782823 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 491/968] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:34.788809 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1401f0-ba09-492a-ba7c-78cdfe69e996 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:34.789237 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1401f0-ba09-492a-ba7c-78cdfe69e996 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:34.789428 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1401f0-ba09-492a-ba7c-78cdfe69e996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:34.798473 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=54 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:28:34.812086 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-4c1401f0-ba09-492a-ba7c-78cdfe69e996 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:34.813304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-4c1401f0-ba09-492a-ba7c-78cdfe69e996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:34.821880 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 478/969] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:35.164896 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4ba15-9a54-487c-8806-58aeb3f497e4 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:35.177366 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4ba15-9a54-487c-8806-58aeb3f497e4 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:35.181568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419dee4f-7c86-46d7-ac31-dab2d6ceba39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:35.182233 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dee4f-7c86-46d7-ac31-dab2d6ceba39 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:35.182510 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dee4f-7c86-46d7-ac31-dab2d6ceba39 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:35.182777 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dee4f-7c86-46d7-ac31-dab2d6ceba39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:35.193093 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419dee4f-7c86-46d7-ac31-dab2d6ceba39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:35.194696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419dee4f-7c86-46d7-ac31-dab2d6ceba39 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:35.205452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 492/970] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:40.851316 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346413d4-91e2-4f12-9156-706d2d1cbc67 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:40.851838 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346413d4-91e2-4f12-9156-706d2d1cbc67 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:40.852081 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346413d4-91e2-4f12-9156-706d2d1cbc67 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:40.853801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 479/971] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 19:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:40.858797 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e52bf6-c1c3-4c4d-a62a-1fa0e4c7f264 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:40.859226 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e52bf6-c1c3-4c4d-a62a-1fa0e4c7f264 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:40.859538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e52bf6-c1c3-4c4d-a62a-1fa0e4c7f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:40.899257 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-f0e52bf6-c1c3-4c4d-a62a-1fa0e4c7f264 None None] MFA Rules not processed for user `35957952c2a142ba868279f19ab4d46d`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:40.900745 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-f0e52bf6-c1c3-4c4d-a62a-1fa0e4c7f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:40.992121 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 493/972] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 19:28:40 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:44.807190 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=2 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:28:45.329356 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02931f-4465-4006-8037-23146ac1f361 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:45.329749 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02931f-4465-4006-8037-23146ac1f361 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:45.329890 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02931f-4465-4006-8037-23146ac1f361 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:45.331480 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 480/973] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 19:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:45.336430 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2e7e2-2aa7-4a09-a9d6-e01f4de162aa None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:45.336902 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2e7e2-2aa7-4a09-a9d6-e01f4de162aa None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:45.336977 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2e7e2-2aa7-4a09-a9d6-e01f4de162aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:45.358246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-03b2e7e2-2aa7-4a09-a9d6-e01f4de162aa None None] MFA Rules not processed for user `35957952c2a142ba868279f19ab4d46d`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:45.359712 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-03b2e7e2-2aa7-4a09-a9d6-e01f4de162aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:45.368569 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 494/974] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 19:28:45 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:46.982615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd59cb-42fd-40ab-9c66-5fe21053ddac None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:46.983232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd59cb-42fd-40ab-9c66-5fe21053ddac None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:46.983232 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd59cb-42fd-40ab-9c66-5fe21053ddac None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:46.984682 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 481/975] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 19:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:46.989911 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ccdf4-245a-4c10-9bf3-3a22729c72af None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:46.990367 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ccdf4-245a-4c10-9bf3-3a22729c72af None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:46.990587 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ccdf4-245a-4c10-9bf3-3a22729c72af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:47.013307 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-a76ccdf4-245a-4c10-9bf3-3a22729c72af None None] MFA Rules not processed for user `35957952c2a142ba868279f19ab4d46d`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:47.014516 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-a76ccdf4-245a-4c10-9bf3-3a22729c72af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:47.023669 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 495/976] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 19:28:46 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:51.029224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4111-c96f-4325-8248-adf7a367c9a1 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:51.029772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4111-c96f-4325-8248-adf7a367c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:51.029772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4111-c96f-4325-8248-adf7a367c9a1 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:51.031376 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 482/977] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:51.036823 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0723d6-e0c6-4bb3-a92d-8ca226a239eb None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:51.037696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0723d6-e0c6-4bb3-a92d-8ca226a239eb None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:51.037792 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0723d6-e0c6-4bb3-a92d-8ca226a239eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:51.061233 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-fd0723d6-e0c6-4bb3-a92d-8ca226a239eb None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:51.062623 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-fd0723d6-e0c6-4bb3-a92d-8ca226a239eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:51.070455 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 496/978] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:28:51.425717 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aed35-0181-4a18-8626-4a2e742d8d1f None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:51.426332 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aed35-0181-4a18-8626-4a2e742d8d1f None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:51.426831 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aed35-0181-4a18-8626-4a2e742d8d1f None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:51.429782 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 483/979] 10.222.0.60 () {54 vars in 962 bytes} [Fri Aug 19 19:28:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:51.439367 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538609f-a668-4579-9f92-14ba56571e41 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:51.440659 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538609f-a668-4579-9f92-14ba56571e41 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:51.441564 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538609f-a668-4579-9f92-14ba56571e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:51.489080 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-5538609f-a668-4579-9f92-14ba56571e41 None None] MFA Rules not processed for user `ff0c7740e6814c6c9515d0aed78bba68`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:51.490712 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-5538609f-a668-4579-9f92-14ba56571e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:51.571486 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=100 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:28:51.578926 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 497/980] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Aug 19 19:28:51 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:51.587015 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aed35-0181-4a18-8626-4a2e742d8d1f None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:51.601305 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aed35-0181-4a18-8626-4a2e742d8d1f None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:51.607607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e060b30-8118-4ab7-a346-bc899425d270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:51.608318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060b30-8118-4ab7-a346-bc899425d270 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:51.608696 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060b30-8118-4ab7-a346-bc899425d270 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:51.609061 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060b30-8118-4ab7-a346-bc899425d270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:51.618560 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e060b30-8118-4ab7-a346-bc899425d270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:51.620178 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e060b30-8118-4ab7-a346-bc899425d270 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:51.630595 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 484/981] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:54.047252 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f78bcb-07fb-4e15-8b4a-ace20c2f2391 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:54.047792 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f78bcb-07fb-4e15-8b4a-ace20c2f2391 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:54.047950 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f78bcb-07fb-4e15-8b4a-ace20c2f2391 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:54.049409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 498/982] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:54.054757 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18030308-239f-4a56-b20b-6e3b5529254e None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:54.055169 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18030308-239f-4a56-b20b-6e3b5529254e None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:54.055343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18030308-239f-4a56-b20b-6e3b5529254e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:54.075774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-18030308-239f-4a56-b20b-6e3b5529254e None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:54.077214 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-18030308-239f-4a56-b20b-6e3b5529254e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:54.085542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 485/983] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:54.452091 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f78bcb-07fb-4e15-8b4a-ace20c2f2391 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:54.467867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f78bcb-07fb-4e15-8b4a-ace20c2f2391 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:54.473077 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fa9bd-760e-4ff8-aa78-8917c357879d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:54.473689 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fa9bd-760e-4ff8-aa78-8917c357879d service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:54.473962 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fa9bd-760e-4ff8-aa78-8917c357879d service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:54.474254 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fa9bd-760e-4ff8-aa78-8917c357879d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:54.484193 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fa9bd-760e-4ff8-aa78-8917c357879d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:54.485789 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fa9bd-760e-4ff8-aa78-8917c357879d service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:54.495719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 499/984] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:57.043190 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cf09c-2de5-4158-a3e9-a39d7902c54d None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:57.044485 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cf09c-2de5-4158-a3e9-a39d7902c54d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:57.049882 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cf09c-2de5-4158-a3e9-a39d7902c54d None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:57.051317 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 486/985] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:57.056821 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89c0da-7c7f-473a-955e-f05f7f5ed844 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:57.057257 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89c0da-7c7f-473a-955e-f05f7f5ed844 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:57.057359 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89c0da-7c7f-473a-955e-f05f7f5ed844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:57.078915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-ae89c0da-7c7f-473a-955e-f05f7f5ed844 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:57.080136 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-ae89c0da-7c7f-473a-955e-f05f7f5ed844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:57.091220 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 500/986] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:57.450192 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1828ec-365c-4712-8358-e00e7e93a582 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:57.450477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1828ec-365c-4712-8358-e00e7e93a582 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:57.450752 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1828ec-365c-4712-8358-e00e7e93a582 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:57.452074 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 487/987] 10.222.0.60 () {54 vars in 962 bytes} [Fri Aug 19 19:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:57.457719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46510-ae64-4e04-8a06-e53a96f0837a None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:57.458090 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46510-ae64-4e04-8a06-e53a96f0837a None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:57.458308 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46510-ae64-4e04-8a06-e53a96f0837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:57.479881 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-aec46510-ae64-4e04-8a06-e53a96f0837a None None] MFA Rules not processed for user `ff0c7740e6814c6c9515d0aed78bba68`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:57.481083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-aec46510-ae64-4e04-8a06-e53a96f0837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:57.491984 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 501/988] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Aug 19 19:28:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:57.500239 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1828ec-365c-4712-8358-e00e7e93a582 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:57.516782 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1828ec-365c-4712-8358-e00e7e93a582 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:57.523505 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af34c5-4596-4d68-af50-cd72c6bb660d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:57.524201 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af34c5-4596-4d68-af50-cd72c6bb660d service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:57.524542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af34c5-4596-4d68-af50-cd72c6bb660d service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:57.524986 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af34c5-4596-4d68-af50-cd72c6bb660d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:57.536158 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af34c5-4596-4d68-af50-cd72c6bb660d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:57.538104 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af34c5-4596-4d68-af50-cd72c6bb660d service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:57.549555 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 488/989] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:59.878076 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa1aae-55d3-42fd-8733-c78cd6ff18b8 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:59.879137 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa1aae-55d3-42fd-8733-c78cd6ff18b8 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:59.879624 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa1aae-55d3-42fd-8733-c78cd6ff18b8 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:59.881692 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 502/990] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:28:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:59.891719 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44dc2a-be43-4b15-9979-6de2bb67647a None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:59.892996 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44dc2a-be43-4b15-9979-6de2bb67647a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:59.893477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44dc2a-be43-4b15-9979-6de2bb67647a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:59.923749 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-3a44dc2a-be43-4b15-9979-6de2bb67647a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:59.926291 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-3a44dc2a-be43-4b15-9979-6de2bb67647a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:59.944488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 489/991] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:28:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:00.310315 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa1aae-55d3-42fd-8733-c78cd6ff18b8 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:00.327001 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa1aae-55d3-42fd-8733-c78cd6ff18b8 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:00.332669 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640a0f0-7666-459d-a235-c183e6a4e094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:00.333525 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a0f0-7666-459d-a235-c183e6a4e094 service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:00.334026 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a0f0-7666-459d-a235-c183e6a4e094 service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:00.334520 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a0f0-7666-459d-a235-c183e6a4e094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:00.343372 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640a0f0-7666-459d-a235-c183e6a4e094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:00.345392 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640a0f0-7666-459d-a235-c183e6a4e094 service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:00.366356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 503/992] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:01.221512 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1a34-2ad0-43aa-9e9d-9456c328a485 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:01.222751 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1a34-2ad0-43aa-9e9d-9456c328a485 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:01.223318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1a34-2ad0-43aa-9e9d-9456c328a485 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:01.229697 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 490/993] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:29:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:01.231395 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f6608-231d-47ba-8f17-9f91a28ca9b0 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:01.231842 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f6608-231d-47ba-8f17-9f91a28ca9b0 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:01.231972 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f6608-231d-47ba-8f17-9f91a28ca9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:01.257760 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-cd5f6608-231d-47ba-8f17-9f91a28ca9b0 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:01.259375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-cd5f6608-231d-47ba-8f17-9f91a28ca9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:01.270041 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 504/994] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:29:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:01.875439 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04287-065a-496d-8a51-5bac5a2621fd None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:01.875439 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04287-065a-496d-8a51-5bac5a2621fd None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:01.875439 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04287-065a-496d-8a51-5bac5a2621fd None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:01.878119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 491/995] 10.222.0.60 () {54 vars in 964 bytes} [Fri Aug 19 19:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:01.884741 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6272b-b33b-41fa-81ae-97657b110266 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:01.885023 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6272b-b33b-41fa-81ae-97657b110266 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:01.885324 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6272b-b33b-41fa-81ae-97657b110266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:01.948389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-b6f6272b-b33b-41fa-81ae-97657b110266 None None] MFA Rules not processed for user `d19d16bc47614980b4f6d57e39a0f4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:01.949798 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-b6f6272b-b33b-41fa-81ae-97657b110266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:02.017848 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 505/996] 10.222.0.60 () {58 vars in 1061 bytes} [Fri Aug 19 19:29:01 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:02.025226 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de04287-065a-496d-8a51-5bac5a2621fd None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:02.037211 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de04287-065a-496d-8a51-5bac5a2621fd None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:02.041646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db51698-3a28-43ca-acd5-67017828aeb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd19d16bc47614980b4f6d57e39a0f4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:02.042558 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db51698-3a28-43ca-acd5-67017828aeb4 service cinder] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:02.043075 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db51698-3a28-43ca-acd5-67017828aeb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:02.043663 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db51698-3a28-43ca-acd5-67017828aeb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:02.053354 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db51698-3a28-43ca-acd5-67017828aeb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:02.055087 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db51698-3a28-43ca-acd5-67017828aeb4 service cinder] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:02.065428 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 492/997] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:02.819169 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92d4f7-af7d-4940-b961-febd7b20edb9 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:02.819756 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92d4f7-af7d-4940-b961-febd7b20edb9 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:02.819756 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92d4f7-af7d-4940-b961-febd7b20edb9 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:02.820925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 506/998] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:02.826642 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe6d7-b811-4cc9-9c39-4b374b219932 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:02.827428 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe6d7-b811-4cc9-9c39-4b374b219932 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:02.828002 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe6d7-b811-4cc9-9c39-4b374b219932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:02.848103 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-f95fe6d7-b811-4cc9-9c39-4b374b219932 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:02.849316 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-f95fe6d7-b811-4cc9-9c39-4b374b219932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:02.859718 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 493/999] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:29:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:03.205119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92d4f7-af7d-4940-b961-febd7b20edb9 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:03.238387 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92d4f7-af7d-4940-b961-febd7b20edb9 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:03.244328 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e3f54-aea2-4279-8852-9d52d9c60b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:03.244942 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3f54-aea2-4279-8852-9d52d9c60b18 service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:03.245408 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3f54-aea2-4279-8852-9d52d9c60b18 service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:03.245985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3f54-aea2-4279-8852-9d52d9c60b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:03.255994 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e3f54-aea2-4279-8852-9d52d9c60b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:03.257836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e3f54-aea2-4279-8852-9d52d9c60b18 service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:03.270945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 507/1000] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:05.542556 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdc801-e058-462f-858e-6d276232cef5 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:05.543095 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdc801-e058-462f-858e-6d276232cef5 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:05.543095 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdc801-e058-462f-858e-6d276232cef5 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:05.544377 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 494/1001] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:05.549698 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233ac7a-2af1-490c-8a10-179d78703fcb None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:05.550172 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233ac7a-2af1-490c-8a10-179d78703fcb None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:05.550317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233ac7a-2af1-490c-8a10-179d78703fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:05.569833 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-a233ac7a-2af1-490c-8a10-179d78703fcb None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:05.571052 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-a233ac7a-2af1-490c-8a10-179d78703fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:05.579132 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 508/1002] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:29:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:05.933957 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdc801-e058-462f-858e-6d276232cef5 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:05.957914 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdc801-e058-462f-858e-6d276232cef5 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:05.968091 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb4b52-d11d-447a-a555-3702ee65c309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:05.969082 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4b52-d11d-447a-a555-3702ee65c309 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:05.969568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4b52-d11d-447a-a555-3702ee65c309 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:05.970102 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4b52-d11d-447a-a555-3702ee65c309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:05.983906 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb4b52-d11d-447a-a555-3702ee65c309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:05.986117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb4b52-d11d-447a-a555-3702ee65c309 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:05.998552 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 495/1003] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:08.233794 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b2575-b508-4031-81c3-9e7fd4059fab None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:08.234429 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b2575-b508-4031-81c3-9e7fd4059fab None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:08.234429 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b2575-b508-4031-81c3-9e7fd4059fab None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:08.235673 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 509/1004] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:08.241156 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f66b9-3c78-4683-86c9-5db40dd7f57e None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:08.241592 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f66b9-3c78-4683-86c9-5db40dd7f57e None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:08.241694 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f66b9-3c78-4683-86c9-5db40dd7f57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:08.265771 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-b15f66b9-3c78-4683-86c9-5db40dd7f57e None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:08.267021 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-b15f66b9-3c78-4683-86c9-5db40dd7f57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:08.277411 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 496/1005] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:29:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:29:08.631081 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b2575-b508-4031-81c3-9e7fd4059fab None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:08.646605 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b2575-b508-4031-81c3-9e7fd4059fab None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:08.653549 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41a14b-8b77-4850-9c19-1c20eca05dd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:08.654519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41a14b-8b77-4850-9c19-1c20eca05dd5 service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:08.655049 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41a14b-8b77-4850-9c19-1c20eca05dd5 service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:08.655530 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41a14b-8b77-4850-9c19-1c20eca05dd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:08.665985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41a14b-8b77-4850-9c19-1c20eca05dd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:08.668015 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41a14b-8b77-4850-9c19-1c20eca05dd5 service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:08.679802 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 510/1006] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:29:10.905976 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e0ac-b4a4-4104-8423-4e679a0355f6 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:10.906937 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e0ac-b4a4-4104-8423-4e679a0355f6 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:10.907209 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e0ac-b4a4-4104-8423-4e679a0355f6 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:10.908628 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 497/1007] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:10.914551 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e423-fd44-4fde-a8ff-016d31787a86 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:10.915011 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e423-fd44-4fde-a8ff-016d31787a86 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:10.915105 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e423-fd44-4fde-a8ff-016d31787a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:10.937882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-75f6e423-fd44-4fde-a8ff-016d31787a86 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:10.939244 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-75f6e423-fd44-4fde-a8ff-016d31787a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:10.949137 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 511/1008] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:29:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:11.309920 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e0ac-b4a4-4104-8423-4e679a0355f6 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:11.326742 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e0ac-b4a4-4104-8423-4e679a0355f6 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:11.334471 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10af96-40e7-4152-bf96-9d39af554d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:11.335483 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10af96-40e7-4152-bf96-9d39af554d04 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:11.335792 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10af96-40e7-4152-bf96-9d39af554d04 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:11.336065 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10af96-40e7-4152-bf96-9d39af554d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:11.347252 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10af96-40e7-4152-bf96-9d39af554d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:11.348918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10af96-40e7-4152-bf96-9d39af554d04 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:11.360355 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 498/1009] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:14.181858 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fdc25-e9fd-4e32-bbc3-74eaecf421f6 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:14.182570 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fdc25-e9fd-4e32-bbc3-74eaecf421f6 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:14.182570 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fdc25-e9fd-4e32-bbc3-74eaecf421f6 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:14.183968 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 512/1010] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:14.190319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1ca36-18c2-4502-811d-8daac963d2b3 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:14.190850 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1ca36-18c2-4502-811d-8daac963d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:14.191073 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1ca36-18c2-4502-811d-8daac963d2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:14.214462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-eaa1ca36-18c2-4502-811d-8daac963d2b3 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:14.216052 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-eaa1ca36-18c2-4502-811d-8daac963d2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:14.225722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 499/1011] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:29:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:14.884108 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fdc25-e9fd-4e32-bbc3-74eaecf421f6 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:14.904889 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fdc25-e9fd-4e32-bbc3-74eaecf421f6 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:14.912087 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84380e12-29fb-409b-a293-5561e1dc83ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:14.912873 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380e12-29fb-409b-a293-5561e1dc83ae service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:14.913180 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380e12-29fb-409b-a293-5561e1dc83ae service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:14.913502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380e12-29fb-409b-a293-5561e1dc83ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:14.924087 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84380e12-29fb-409b-a293-5561e1dc83ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:14.925736 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84380e12-29fb-409b-a293-5561e1dc83ae service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:14.936337 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 513/1012] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:17.608729 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50c4f6-eb95-4cee-aad1-f33167bbc9aa None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:17.609358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50c4f6-eb95-4cee-aad1-f33167bbc9aa None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:17.609358 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50c4f6-eb95-4cee-aad1-f33167bbc9aa None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:17.610625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 500/1013] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:17.616293 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc85138-9120-4601-82bc-07557851b0a0 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:17.616765 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc85138-9120-4601-82bc-07557851b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:17.616863 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc85138-9120-4601-82bc-07557851b0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:17.637211 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-abc85138-9120-4601-82bc-07557851b0a0 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:17.638158 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-abc85138-9120-4601-82bc-07557851b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:17.646859 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 514/1014] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:29:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:18.004167 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50c4f6-eb95-4cee-aad1-f33167bbc9aa None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:18.012305 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=46 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:29:18.019624 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50c4f6-eb95-4cee-aad1-f33167bbc9aa None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:18.028235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e19ee-7cc8-4e79-9cd8-62fb41569839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:18.028835 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e19ee-7cc8-4e79-9cd8-62fb41569839 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:18.029108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e19ee-7cc8-4e79-9cd8-62fb41569839 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:18.029374 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e19ee-7cc8-4e79-9cd8-62fb41569839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:18.038735 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e19ee-7cc8-4e79-9cd8-62fb41569839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:18.040314 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e19ee-7cc8-4e79-9cd8-62fb41569839 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:18.050091 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 501/1015] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:18.057768 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a8a2-b276-419b-9fc4-10c5bee427c2 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:18.058084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a8a2-b276-419b-9fc4-10c5bee427c2 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:18.058390 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a8a2-b276-419b-9fc4-10c5bee427c2 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:18.059929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 515/1016] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:18.065342 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd011f-1edc-45a0-aaac-c92f5e2d1c92 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:18.065625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd011f-1edc-45a0-aaac-c92f5e2d1c92 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:18.065942 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd011f-1edc-45a0-aaac-c92f5e2d1c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:18.085414 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-12bd011f-1edc-45a0-aaac-c92f5e2d1c92 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:18.086633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-12bd011f-1edc-45a0-aaac-c92f5e2d1c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:18.095067 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 502/1017] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:29:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:18.454306 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d82087-034b-4e67-bf18-3453814930bf None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:18.454572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d82087-034b-4e67-bf18-3453814930bf None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:18.454815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d82087-034b-4e67-bf18-3453814930bf None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:18.456353 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 516/1018] 10.222.0.60 () {54 vars in 967 bytes} [Fri Aug 19 19:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:18.461224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21097027-db19-448d-b880-9491265d8445 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:18.461507 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21097027-db19-448d-b880-9491265d8445 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:18.461774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21097027-db19-448d-b880-9491265d8445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:18.501430 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-21097027-db19-448d-b880-9491265d8445 None None] MFA Rules not processed for user `5f36f349d532411ba09da3231aef3f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:18.502671 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-21097027-db19-448d-b880-9491265d8445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:18.566681 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 503/1019] 10.222.0.60 () {58 vars in 1064 bytes} [Fri Aug 19 19:29:18 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:18.574388 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d82087-034b-4e67-bf18-3453814930bf None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:18.586120 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d82087-034b-4e67-bf18-3453814930bf None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:18.589887 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460ef81-4e83-4ed8-a139-f4db8b022e28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f36f349d532411ba09da3231aef3f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:18.590556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460ef81-4e83-4ed8-a139-f4db8b022e28 service glance] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:18.590829 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460ef81-4e83-4ed8-a139-f4db8b022e28 service glance] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:18.591096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460ef81-4e83-4ed8-a139-f4db8b022e28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:18.600830 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460ef81-4e83-4ed8-a139-f4db8b022e28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:18.602289 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460ef81-4e83-4ed8-a139-f4db8b022e28 service glance] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:18.612843 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 517/1020] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:20.366534 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b7c7-aff6-4258-a2c3-9a0d22fa3a84 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:20.367190 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b7c7-aff6-4258-a2c3-9a0d22fa3a84 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:20.367190 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b7c7-aff6-4258-a2c3-9a0d22fa3a84 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:20.370086 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 504/1021] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:20.374556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40743f-7f23-4573-b975-11920879cbbe None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:20.375079 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40743f-7f23-4573-b975-11920879cbbe None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:20.375079 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40743f-7f23-4573-b975-11920879cbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:20.395627 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-8a40743f-7f23-4573-b975-11920879cbbe None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:20.396863 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-8a40743f-7f23-4573-b975-11920879cbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:20.406231 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 518/1022] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:29:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:29:20.749893 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9b7c7-aff6-4258-a2c3-9a0d22fa3a84 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:20.766282 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9b7c7-aff6-4258-a2c3-9a0d22fa3a84 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:20.771738 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60763111-1cf4-4636-af7e-d9514d175650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:20.772359 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60763111-1cf4-4636-af7e-d9514d175650 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:20.772636 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60763111-1cf4-4636-af7e-d9514d175650 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:20.772897 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60763111-1cf4-4636-af7e-d9514d175650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:20.785171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60763111-1cf4-4636-af7e-d9514d175650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:20.787220 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60763111-1cf4-4636-af7e-d9514d175650 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:20.801661 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 505/1023] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:23.093813 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b678-1756-4535-8c76-27582bfffc3c None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:23.094475 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b678-1756-4535-8c76-27582bfffc3c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:23.094475 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b678-1756-4535-8c76-27582bfffc3c None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:23.095809 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 519/1024] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:23.101340 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8c2a-038c-4eaa-ae2c-e9aac323376e None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:23.101814 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8c2a-038c-4eaa-ae2c-e9aac323376e None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:23.101915 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8c2a-038c-4eaa-ae2c-e9aac323376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:23.125106 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-3aad8c2a-038c-4eaa-ae2c-e9aac323376e None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:23.126373 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-3aad8c2a-038c-4eaa-ae2c-e9aac323376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:23.138030 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 506/1025] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:29:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:23.486527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b678-1756-4535-8c76-27582bfffc3c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:23.497377 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=92 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:29:23.504757 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b678-1756-4535-8c76-27582bfffc3c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:23.509930 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a4350-8cee-4455-90ae-bbc440b1e617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:23.510566 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a4350-8cee-4455-90ae-bbc440b1e617 service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:23.510831 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a4350-8cee-4455-90ae-bbc440b1e617 service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:23.511101 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a4350-8cee-4455-90ae-bbc440b1e617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:23.520288 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a4350-8cee-4455-90ae-bbc440b1e617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:23.521904 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a4350-8cee-4455-90ae-bbc440b1e617 service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:23.534409 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 520/1026] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:33.119517 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=50 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:29:33.527973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=5 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:29:33.934745 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec3406-d395-43db-ab55-0a7e6a68ddb9 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:33.934970 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec3406-d395-43db-ab55-0a7e6a68ddb9 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:33.935160 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec3406-d395-43db-ab55-0a7e6a68ddb9 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:33.936502 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 507/1027] 10.222.0.60 () {54 vars in 918 bytes} [Fri Aug 19 19:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:33.944450 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7eccc1-1ac9-418f-bb83-0902204c76e0 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:33.944728 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7eccc1-1ac9-418f-bb83-0902204c76e0 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:33.945055 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7eccc1-1ac9-418f-bb83-0902204c76e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:33.966861 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-8e7eccc1-1ac9-418f-bb83-0902204c76e0 None None] MFA Rules not processed for user `35957952c2a142ba868279f19ab4d46d`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:33.968083 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-8e7eccc1-1ac9-418f-bb83-0902204c76e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:33.978614 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 521/1028] 10.222.0.60 () {58 vars in 1015 bytes} [Fri Aug 19 19:29:33 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:33.994097 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c03a8-1b7b-4d8d-b099-04e65cd7b4ec None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:33.994227 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c03a8-1b7b-4d8d-b099-04e65cd7b4ec None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:33.994442 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c03a8-1b7b-4d8d-b099-04e65cd7b4ec None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:33.995711 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 508/1029] 10.222.0.60 () {54 vars in 918 bytes} [Fri Aug 19 19:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:34.000709 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ffe48-c33d-46b0-a0a8-a040e1e62321 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:34.000987 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ffe48-c33d-46b0-a0a8-a040e1e62321 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:34.001258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ffe48-c33d-46b0-a0a8-a040e1e62321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:34.021606 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-c83ffe48-c33d-46b0-a0a8-a040e1e62321 None None] MFA Rules not processed for user `ff0c7740e6814c6c9515d0aed78bba68`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:34.022822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-c83ffe48-c33d-46b0-a0a8-a040e1e62321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:34.031863 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 522/1030] 10.222.0.60 () {58 vars in 1015 bytes} [Fri Aug 19 19:29:33 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:36.734883 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc735a7-4e32-4d75-b14c-333131508ea6 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:36.735801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc735a7-4e32-4d75-b14c-333131508ea6 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:36.735801 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc735a7-4e32-4d75-b14c-333131508ea6 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:36.738154 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 509/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:29:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:36.747142 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081db1d-46a2-421b-b0ad-7b5efd132711 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:36.747743 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081db1d-46a2-421b-b0ad-7b5efd132711 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:36.747743 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081db1d-46a2-421b-b0ad-7b5efd132711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:36.769976 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-e081db1d-46a2-421b-b0ad-7b5efd132711 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:36.771233 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-e081db1d-46a2-421b-b0ad-7b5efd132711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:36.779592 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 523/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:29:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:29:37.132907 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc735a7-4e32-4d75-b14c-333131508ea6 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:37.150559 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc735a7-4e32-4d75-b14c-333131508ea6 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:37.156390 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6542c50-d532-4819-b7a3-aa90e13b697a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:37.156976 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542c50-d532-4819-b7a3-aa90e13b697a service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:37.157245 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542c50-d532-4819-b7a3-aa90e13b697a service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:37.157507 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542c50-d532-4819-b7a3-aa90e13b697a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:37.166707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6542c50-d532-4819-b7a3-aa90e13b697a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:37.168910 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6542c50-d532-4819-b7a3-aa90e13b697a service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:37.178537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 510/1033] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:38.146343 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867c662-e0f9-40b0-b7fb-92db66d15007 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:38.147207 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867c662-e0f9-40b0-b7fb-92db66d15007 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:38.147207 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867c662-e0f9-40b0-b7fb-92db66d15007 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:38.149397 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 524/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:29:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:38.154804 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06f52a-e4dd-4568-9265-f6a102152ca4 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:38.155239 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06f52a-e4dd-4568-9265-f6a102152ca4 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:38.155348 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06f52a-e4dd-4568-9265-f6a102152ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:38.184951 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-0a06f52a-e4dd-4568-9265-f6a102152ca4 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:38.186205 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-0a06f52a-e4dd-4568-9265-f6a102152ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:38.202368 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 511/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:29:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:38.408973 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867c662-e0f9-40b0-b7fb-92db66d15007 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:38.428200 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867c662-e0f9-40b0-b7fb-92db66d15007 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:38.434631 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bbca7-fce7-43cf-8fb9-170c1e7f493c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:38.435238 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bbca7-fce7-43cf-8fb9-170c1e7f493c service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:38.435536 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bbca7-fce7-43cf-8fb9-170c1e7f493c service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:38.435806 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bbca7-fce7-43cf-8fb9-170c1e7f493c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:38.445069 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bbca7-fce7-43cf-8fb9-170c1e7f493c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:38.446741 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bbca7-fce7-43cf-8fb9-170c1e7f493c service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:38.456833 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 525/1036] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:39.382055 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ed025-6e5a-4efa-bb3c-24db23e98462 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:39.382983 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ed025-6e5a-4efa-bb3c-24db23e98462 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:39.383666 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ed025-6e5a-4efa-bb3c-24db23e98462 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:39.385815 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 512/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:29:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:39.391568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f7e3e-fdc2-44c3-bea5-a2b47ab69a72 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:39.392007 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f7e3e-fdc2-44c3-bea5-a2b47ab69a72 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:39.392111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f7e3e-fdc2-44c3-bea5-a2b47ab69a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:39.413294 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-9c3f7e3e-fdc2-44c3-bea5-a2b47ab69a72 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:39.414551 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-9c3f7e3e-fdc2-44c3-bea5-a2b47ab69a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:39.423653 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 526/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:29:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:39.589106 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ed025-6e5a-4efa-bb3c-24db23e98462 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:39.604184 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ed025-6e5a-4efa-bb3c-24db23e98462 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:39.610248 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc51b15-abd2-4373-bc8b-3d2ef93e3ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:39.610840 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51b15-abd2-4373-bc8b-3d2ef93e3ddb service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:39.611107 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51b15-abd2-4373-bc8b-3d2ef93e3ddb service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:39.611377 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51b15-abd2-4373-bc8b-3d2ef93e3ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:39.620464 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc51b15-abd2-4373-bc8b-3d2ef93e3ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:39.622190 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc51b15-abd2-4373-bc8b-3d2ef93e3ddb service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:39.631705 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 513/1039] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:40.528694 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a219f7d-0549-4197-a27a-dc90b3bd3098 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:40.529391 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a219f7d-0549-4197-a27a-dc90b3bd3098 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:40.529391 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a219f7d-0549-4197-a27a-dc90b3bd3098 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:40.530594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 527/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:40.536807 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f991c-3e49-4b86-b884-d420dc08ea88 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:40.537273 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f991c-3e49-4b86-b884-d420dc08ea88 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:40.537379 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f991c-3e49-4b86-b884-d420dc08ea88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:40.564863 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-992f991c-3e49-4b86-b884-d420dc08ea88 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:40.566092 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-992f991c-3e49-4b86-b884-d420dc08ea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:40.576073 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 514/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:29:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:40.743783 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a219f7d-0549-4197-a27a-dc90b3bd3098 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:40.759711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a219f7d-0549-4197-a27a-dc90b3bd3098 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:40.765642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4c7c9-25ae-4329-8479-5a50d2a0206e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:40.766264 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c7c9-25ae-4329-8479-5a50d2a0206e service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:40.766538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c7c9-25ae-4329-8479-5a50d2a0206e service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:40.766809 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c7c9-25ae-4329-8479-5a50d2a0206e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:40.775171 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4c7c9-25ae-4329-8479-5a50d2a0206e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:40.776752 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4c7c9-25ae-4329-8479-5a50d2a0206e service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:40.786830 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 528/1042] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:41.662732 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc3d48-4954-4428-b3ce-3a375620a242 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:41.663372 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc3d48-4954-4428-b3ce-3a375620a242 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:41.663372 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc3d48-4954-4428-b3ce-3a375620a242 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:41.664615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 515/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:41.670594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4bf33-d68c-4090-adee-bb40ebbf238e None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:41.671336 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4bf33-d68c-4090-adee-bb40ebbf238e None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:41.671336 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4bf33-d68c-4090-adee-bb40ebbf238e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:41.700920 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-28e4bf33-d68c-4090-adee-bb40ebbf238e None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:41.702137 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-28e4bf33-d68c-4090-adee-bb40ebbf238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:41.710030 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 529/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:29:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:41.863308 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc3d48-4954-4428-b3ce-3a375620a242 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:41.878774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc3d48-4954-4428-b3ce-3a375620a242 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:41.884488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0f12a-1d1f-47fc-be62-44c8c1bc3e53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:41.885068 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0f12a-1d1f-47fc-be62-44c8c1bc3e53 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:41.885363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0f12a-1d1f-47fc-be62-44c8c1bc3e53 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:41.885626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0f12a-1d1f-47fc-be62-44c8c1bc3e53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:41.894027 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0f12a-1d1f-47fc-be62-44c8c1bc3e53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:41.895630 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0f12a-1d1f-47fc-be62-44c8c1bc3e53 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:41.906310 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 516/1045] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:42.749816 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbf8fa-f122-47fa-9572-f9dbc1ffcd89 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:42.750800 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbf8fa-f122-47fa-9572-f9dbc1ffcd89 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:42.750800 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbf8fa-f122-47fa-9572-f9dbc1ffcd89 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:42.752852 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 530/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:29:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:42.759035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d327-21b8-45e1-af29-4dcab05dde4a None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:42.759734 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d327-21b8-45e1-af29-4dcab05dde4a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:42.759911 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d327-21b8-45e1-af29-4dcab05dde4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:42.787664 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-6559d327-21b8-45e1-af29-4dcab05dde4a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:42.788896 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-6559d327-21b8-45e1-af29-4dcab05dde4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:42.797865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 517/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:29:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:42.953763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbf8fa-f122-47fa-9572-f9dbc1ffcd89 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:42.971611 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbf8fa-f122-47fa-9572-f9dbc1ffcd89 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:42.976616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87985ea4-c1f5-4df7-aa70-750571a274e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:42.977218 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985ea4-c1f5-4df7-aa70-750571a274e9 service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:42.977488 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985ea4-c1f5-4df7-aa70-750571a274e9 service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:42.977792 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985ea4-c1f5-4df7-aa70-750571a274e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:42.986278 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87985ea4-c1f5-4df7-aa70-750571a274e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:42.987862 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87985ea4-c1f5-4df7-aa70-750571a274e9 service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:42.997205 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 531/1048] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:43.819467 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be63486-97a9-47d8-bca2-3006a1174f95 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:43.820379 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be63486-97a9-47d8-bca2-3006a1174f95 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:43.820379 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be63486-97a9-47d8-bca2-3006a1174f95 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:43.822684 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 518/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:29:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:43.828020 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d9a0-81c3-4dcc-8140-9eb5ec9e43cb None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:43.828473 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d9a0-81c3-4dcc-8140-9eb5ec9e43cb None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:43.828565 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d9a0-81c3-4dcc-8140-9eb5ec9e43cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:43.849387 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-0086d9a0-81c3-4dcc-8140-9eb5ec9e43cb None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:43.850623 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-0086d9a0-81c3-4dcc-8140-9eb5ec9e43cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:43.860225 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 532/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:29:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:44.029700 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be63486-97a9-47d8-bca2-3006a1174f95 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:44.047058 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be63486-97a9-47d8-bca2-3006a1174f95 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:44.053531 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcb095-9d9e-4842-8e86-f8d176e92004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:44.054157 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcb095-9d9e-4842-8e86-f8d176e92004 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:44.054436 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcb095-9d9e-4842-8e86-f8d176e92004 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:44.054704 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcb095-9d9e-4842-8e86-f8d176e92004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:44.063819 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcb095-9d9e-4842-8e86-f8d176e92004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:44.065417 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcb095-9d9e-4842-8e86-f8d176e92004 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:44.075572 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 519/1051] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:44.885751 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1539d2-9db2-4917-bb16-783cc7c3ce2d None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:44.886386 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1539d2-9db2-4917-bb16-783cc7c3ce2d None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:44.886386 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1539d2-9db2-4917-bb16-783cc7c3ce2d None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:44.888009 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 533/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:44.894129 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8f18-b61b-4748-a322-4dc49de1ceb2 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:44.894836 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8f18-b61b-4748-a322-4dc49de1ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:44.894982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8f18-b61b-4748-a322-4dc49de1ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:44.918960 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-f0df8f18-b61b-4748-a322-4dc49de1ceb2 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:44.920148 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-f0df8f18-b61b-4748-a322-4dc49de1ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:44.928966 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 520/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:29:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:45.085835 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1539d2-9db2-4917-bb16-783cc7c3ce2d None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:45.101648 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1539d2-9db2-4917-bb16-783cc7c3ce2d None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:45.107689 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1b890-386c-4bba-98b6-1e3af82344b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:45.108277 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b890-386c-4bba-98b6-1e3af82344b1 service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:45.108545 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b890-386c-4bba-98b6-1e3af82344b1 service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:45.108811 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b890-386c-4bba-98b6-1e3af82344b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:45.116933 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1b890-386c-4bba-98b6-1e3af82344b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:45.118543 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1b890-386c-4bba-98b6-1e3af82344b1 service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:45.127921 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 534/1054] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:45.948948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fefdf-4d91-416e-af19-cb023ed8bd55 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:45.949655 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fefdf-4d91-416e-af19-cb023ed8bd55 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:45.949753 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fefdf-4d91-416e-af19-cb023ed8bd55 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:45.951184 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 521/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:45.956330 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1d836-4c97-40f8-93f3-ae670b17cb23 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:45.956768 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1d836-4c97-40f8-93f3-ae670b17cb23 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:45.956861 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1d836-4c97-40f8-93f3-ae670b17cb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:45.978333 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-08e1d836-4c97-40f8-93f3-ae670b17cb23 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:45.979514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-08e1d836-4c97-40f8-93f3-ae670b17cb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:45.988422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 535/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:29:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:46.143467 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fefdf-4d91-416e-af19-cb023ed8bd55 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:46.169046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fefdf-4d91-416e-af19-cb023ed8bd55 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:46.175380 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ccd01-1462-44e7-a2cc-6ef99d32774f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:46.176016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ccd01-1462-44e7-a2cc-6ef99d32774f service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:46.176335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ccd01-1462-44e7-a2cc-6ef99d32774f service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:46.176649 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ccd01-1462-44e7-a2cc-6ef99d32774f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:46.186017 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ccd01-1462-44e7-a2cc-6ef99d32774f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:46.187653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ccd01-1462-44e7-a2cc-6ef99d32774f service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:46.198426 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 522/1057] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:48.300017 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2196ae2-0136-47f5-9bb4-b9a60f7a9dac None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:48.300907 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2196ae2-0136-47f5-9bb4-b9a60f7a9dac None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:48.300907 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2196ae2-0136-47f5-9bb4-b9a60f7a9dac None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:48.303085 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 536/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:29:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:48.308586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca17e8-379d-4cf7-87ee-b0322b4c1790 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:48.309148 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca17e8-379d-4cf7-87ee-b0322b4c1790 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:48.309148 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca17e8-379d-4cf7-87ee-b0322b4c1790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:48.330108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-b4ca17e8-379d-4cf7-87ee-b0322b4c1790 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:48.331267 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-b4ca17e8-379d-4cf7-87ee-b0322b4c1790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:48.339705 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 523/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:29:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:48.683507 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2196ae2-0136-47f5-9bb4-b9a60f7a9dac None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:48.697792 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2196ae2-0136-47f5-9bb4-b9a60f7a9dac None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:48.702607 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e74c0-785c-4326-86de-cee710392706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:48.703202 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e74c0-785c-4326-86de-cee710392706 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:48.703497 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e74c0-785c-4326-86de-cee710392706 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:48.703763 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e74c0-785c-4326-86de-cee710392706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:48.714715 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e74c0-785c-4326-86de-cee710392706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:48.716765 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e74c0-785c-4326-86de-cee710392706 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:48.726709 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 537/1060] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:51.170469 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7a088-d091-4045-8d88-105c60f0c316 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:51.171334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7a088-d091-4045-8d88-105c60f0c316 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:51.171334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7a088-d091-4045-8d88-105c60f0c316 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:51.173394 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 524/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:29:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:51.179892 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484c3e8-9ea5-4513-9abf-ea0bdbf153ba None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:51.180444 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484c3e8-9ea5-4513-9abf-ea0bdbf153ba None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:51.180594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484c3e8-9ea5-4513-9abf-ea0bdbf153ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:51.207214 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-e484c3e8-9ea5-4513-9abf-ea0bdbf153ba None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:51.208420 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-e484c3e8-9ea5-4513-9abf-ea0bdbf153ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:51.217354 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 538/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:29:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:51.565749 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7a088-d091-4045-8d88-105c60f0c316 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:51.579796 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7a088-d091-4045-8d88-105c60f0c316 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:51.584522 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24910d7d-e2e4-4d00-a9e1-6bee6cad687b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:51.585110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24910d7d-e2e4-4d00-a9e1-6bee6cad687b service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:51.585386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24910d7d-e2e4-4d00-a9e1-6bee6cad687b service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:51.585653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24910d7d-e2e4-4d00-a9e1-6bee6cad687b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:51.595696 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24910d7d-e2e4-4d00-a9e1-6bee6cad687b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:51.597157 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24910d7d-e2e4-4d00-a9e1-6bee6cad687b service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:51.607233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 525/1063] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:54.156141 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de3233-cfe3-4602-babc-22bbf463c3e9 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:54.156674 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de3233-cfe3-4602-babc-22bbf463c3e9 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:54.156674 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de3233-cfe3-4602-babc-22bbf463c3e9 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:54.158094 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 539/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:54.164025 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bdd76-63f7-46c8-a797-14bde45feb25 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:54.164481 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bdd76-63f7-46c8-a797-14bde45feb25 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:54.164584 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bdd76-63f7-46c8-a797-14bde45feb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:54.192955 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-034bdd76-63f7-46c8-a797-14bde45feb25 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:54.194217 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-034bdd76-63f7-46c8-a797-14bde45feb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:54.203915 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 526/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:29:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:54.555641 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de3233-cfe3-4602-babc-22bbf463c3e9 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:54.568755 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de3233-cfe3-4602-babc-22bbf463c3e9 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:54.572761 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf3fd1-cb36-45f9-aa58-2cbfdde837a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:54.573346 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3fd1-cb36-45f9-aa58-2cbfdde837a2 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:54.573616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3fd1-cb36-45f9-aa58-2cbfdde837a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:54.573879 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3fd1-cb36-45f9-aa58-2cbfdde837a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:54.583338 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf3fd1-cb36-45f9-aa58-2cbfdde837a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:54.584768 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf3fd1-cb36-45f9-aa58-2cbfdde837a2 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:54.594180 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 540/1066] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:56.923709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d30b5-bf7d-4a6e-98b0-54c27dc388ee None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:56.924237 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d30b5-bf7d-4a6e-98b0-54c27dc388ee None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:56.924237 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d30b5-bf7d-4a6e-98b0-54c27dc388ee None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:56.926462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 527/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:29:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:56.932776 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e02fb9-a89c-4807-a05e-baa1409ef1e5 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:56.933272 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e02fb9-a89c-4807-a05e-baa1409ef1e5 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:56.933402 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e02fb9-a89c-4807-a05e-baa1409ef1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:56.953293 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-a3e02fb9-a89c-4807-a05e-baa1409ef1e5 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:56.954525 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-a3e02fb9-a89c-4807-a05e-baa1409ef1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:56.963403 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 541/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:29:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:57.304730 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d30b5-bf7d-4a6e-98b0-54c27dc388ee None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:57.318111 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d30b5-bf7d-4a6e-98b0-54c27dc388ee None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:57.322489 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbf76b-a020-4ead-a0d9-fa7e9b32bf50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:57.323073 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbf76b-a020-4ead-a0d9-fa7e9b32bf50 service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:57.323340 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbf76b-a020-4ead-a0d9-fa7e9b32bf50 service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:57.323632 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbf76b-a020-4ead-a0d9-fa7e9b32bf50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:57.332858 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbf76b-a020-4ead-a0d9-fa7e9b32bf50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:57.334311 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbf76b-a020-4ead-a0d9-fa7e9b32bf50 service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:57.343969 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 528/1069] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:29:59.637213 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c4f2-6a91-4d87-aaf8-80010cb8f189 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:59.637803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c4f2-6a91-4d87-aaf8-80010cb8f189 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:59.637803 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c4f2-6a91-4d87-aaf8-80010cb8f189 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:59.639142 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 542/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:29:59.644786 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16af3-e3a8-4120-9ce3-5994d356911a None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:59.645216 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16af3-e3a8-4120-9ce3-5994d356911a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:59.645318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16af3-e3a8-4120-9ce3-5994d356911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:59.668419 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-6db16af3-e3a8-4120-9ce3-5994d356911a None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:59.669617 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-6db16af3-e3a8-4120-9ce3-5994d356911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:59.678877 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 529/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:29:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:00.017968 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174c4f2-6a91-4d87-aaf8-80010cb8f189 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:00.034641 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174c4f2-6a91-4d87-aaf8-80010cb8f189 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:00.039069 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c2a27-4c81-4259-b102-c4efbe72c53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:00.039677 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c2a27-4c81-4259-b102-c4efbe72c53d service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:00.039947 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c2a27-4c81-4259-b102-c4efbe72c53d service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:00.040182 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c2a27-4c81-4259-b102-c4efbe72c53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:00.050168 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c2a27-4c81-4259-b102-c4efbe72c53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:00.051600 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c2a27-4c81-4259-b102-c4efbe72c53d service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:00.063831 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 543/1072] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:02.314289 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2054b-3b32-4a42-85c2-58a21f4db832 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:02.314917 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2054b-3b32-4a42-85c2-58a21f4db832 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:02.314917 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2054b-3b32-4a42-85c2-58a21f4db832 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:02.316171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 530/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:02.323630 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf842400-5d96-4636-85a4-2beaaff46d91 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:02.324494 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf842400-5d96-4636-85a4-2beaaff46d91 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:02.324865 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf842400-5d96-4636-85a4-2beaaff46d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:02.356412 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-cf842400-5d96-4636-85a4-2beaaff46d91 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:02.357631 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-cf842400-5d96-4636-85a4-2beaaff46d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:02.367472 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 544/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:30:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:02.706483 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2054b-3b32-4a42-85c2-58a21f4db832 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:02.721854 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2054b-3b32-4a42-85c2-58a21f4db832 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:02.726233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112178b-5c9e-404e-8073-c2d9e148a84b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:02.726825 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112178b-5c9e-404e-8073-c2d9e148a84b service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:02.727096 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112178b-5c9e-404e-8073-c2d9e148a84b service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:02.727387 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112178b-5c9e-404e-8073-c2d9e148a84b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:02.736664 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112178b-5c9e-404e-8073-c2d9e148a84b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:02.738109 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112178b-5c9e-404e-8073-c2d9e148a84b service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:02.747680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 531/1075] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:30:04.977520 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe2a2b-c29f-45fb-8146-4cabed71381c None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:04.978142 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe2a2b-c29f-45fb-8146-4cabed71381c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:04.978142 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe2a2b-c29f-45fb-8146-4cabed71381c None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:04.980234 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 545/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:30:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:04.989476 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16130436-d9a9-42f7-a375-29efeb47d0df None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:04.989943 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16130436-d9a9-42f7-a375-29efeb47d0df None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:04.990101 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16130436-d9a9-42f7-a375-29efeb47d0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:05.000384 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=70 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:05.013646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-16130436-d9a9-42f7-a375-29efeb47d0df None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:05.014938 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-16130436-d9a9-42f7-a375-29efeb47d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:05.023651 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 532/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:30:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:05.361284 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe2a2b-c29f-45fb-8146-4cabed71381c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:05.370985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=73 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:05.380442 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe2a2b-c29f-45fb-8146-4cabed71381c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:05.387726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72d7db-51d8-4dd4-a4f6-a4bacac01884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:05.388348 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d7db-51d8-4dd4-a4f6-a4bacac01884 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:05.388624 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d7db-51d8-4dd4-a4f6-a4bacac01884 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:05.388895 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d7db-51d8-4dd4-a4f6-a4bacac01884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:05.399106 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72d7db-51d8-4dd4-a4f6-a4bacac01884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:05.400546 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72d7db-51d8-4dd4-a4f6-a4bacac01884 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:05.411367 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 546/1078] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:07.693646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d5a42-460c-40f4-afd9-bebaf463f28b None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:07.694577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d5a42-460c-40f4-afd9-bebaf463f28b None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:07.694577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d5a42-460c-40f4-afd9-bebaf463f28b None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:07.696635 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 533/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:30:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:07.703774 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0c25-7f30-4b8d-8c0a-677fcf19a637 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:07.704521 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0c25-7f30-4b8d-8c0a-677fcf19a637 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:07.704648 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0c25-7f30-4b8d-8c0a-677fcf19a637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:07.735966 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-d15f0c25-7f30-4b8d-8c0a-677fcf19a637 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:07.737196 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-d15f0c25-7f30-4b8d-8c0a-677fcf19a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:07.747072 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 547/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:30:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:08.094623 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d5a42-460c-40f4-afd9-bebaf463f28b None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:08.114845 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d5a42-460c-40f4-afd9-bebaf463f28b None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:08.121688 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c76e3-1bfb-4249-ac94-66a3e9729f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:08.122313 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c76e3-1bfb-4249-ac94-66a3e9729f38 service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:08.122614 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c76e3-1bfb-4249-ac94-66a3e9729f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:08.122876 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c76e3-1bfb-4249-ac94-66a3e9729f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:08.133060 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c76e3-1bfb-4249-ac94-66a3e9729f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:08.134537 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c76e3-1bfb-4249-ac94-66a3e9729f38 service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:08.144751 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 534/1081] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:10.349985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30dac0-e5cf-41fc-9996-be828d6ccb07 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:10.350946 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30dac0-e5cf-41fc-9996-be828d6ccb07 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:10.350946 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30dac0-e5cf-41fc-9996-be828d6ccb07 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:10.353008 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 548/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:30:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:10.361648 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ab7e9-38da-44f8-9d80-9a9f404bfd8e None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:10.362211 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ab7e9-38da-44f8-9d80-9a9f404bfd8e None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:10.362371 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ab7e9-38da-44f8-9d80-9a9f404bfd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:10.382589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-9e2ab7e9-38da-44f8-9d80-9a9f404bfd8e None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:10.383788 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-9e2ab7e9-38da-44f8-9d80-9a9f404bfd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:10.393032 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 535/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:30:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:10.733637 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30dac0-e5cf-41fc-9996-be828d6ccb07 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:10.752582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30dac0-e5cf-41fc-9996-be828d6ccb07 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:10.759053 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53c744-0874-48cb-ac17-16291610406b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:10.759950 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c744-0874-48cb-ac17-16291610406b service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:10.760290 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c744-0874-48cb-ac17-16291610406b service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:10.760638 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c744-0874-48cb-ac17-16291610406b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:10.774636 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53c744-0874-48cb-ac17-16291610406b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:10.776769 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53c744-0874-48cb-ac17-16291610406b service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:10.792421 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 549/1084] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:13.029946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f5c83-bcc2-415f-bbcf-689745cec21a None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:13.030950 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f5c83-bcc2-415f-bbcf-689745cec21a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:13.030950 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f5c83-bcc2-415f-bbcf-689745cec21a None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:13.032968 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 536/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:30:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:13.038847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eeafc-abbf-4d79-bab4-fb6b2019aca4 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:13.039316 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eeafc-abbf-4d79-bab4-fb6b2019aca4 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:13.039418 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eeafc-abbf-4d79-bab4-fb6b2019aca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:13.060258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-170eeafc-abbf-4d79-bab4-fb6b2019aca4 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:13.061471 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-170eeafc-abbf-4d79-bab4-fb6b2019aca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:13.070509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 550/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:30:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:13.413756 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f5c83-bcc2-415f-bbcf-689745cec21a None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:13.433773 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f5c83-bcc2-415f-bbcf-689745cec21a None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:13.441799 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0d055-503b-4908-ad49-1886cd7477fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:13.443665 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d055-503b-4908-ad49-1886cd7477fd service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:13.444089 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d055-503b-4908-ad49-1886cd7477fd service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:13.444531 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d055-503b-4908-ad49-1886cd7477fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:13.466454 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0d055-503b-4908-ad49-1886cd7477fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:13.468811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0d055-503b-4908-ad49-1886cd7477fd service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:13.485477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 537/1087] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:23.054999 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=17 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:23.477574 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=17 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:37.586942 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db15e-f84e-4419-a0b0-9a689a134c3d None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:37.587578 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db15e-f84e-4419-a0b0-9a689a134c3d None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:37.587578 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db15e-f84e-4419-a0b0-9a689a134c3d None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:37.588864 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 551/1088] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:37.595274 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d626aba-19b4-40be-abe6-9c3b85973d78 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:37.596043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d626aba-19b4-40be-abe6-9c3b85973d78 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:37.596178 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d626aba-19b4-40be-abe6-9c3b85973d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:37.619911 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-0d626aba-19b4-40be-abe6-9c3b85973d78 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:37.621114 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-0d626aba-19b4-40be-abe6-9c3b85973d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:37.630471 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 538/1089] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:30:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:37.991435 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307ee12-4d7c-4e5b-af39-7fc7c04982f3 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:37.991715 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307ee12-4d7c-4e5b-af39-7fc7c04982f3 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:37.991986 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307ee12-4d7c-4e5b-af39-7fc7c04982f3 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:37.993345 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 552/1090] 10.222.0.60 () {54 vars in 967 bytes} [Fri Aug 19 19:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:30:37.998943 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bc38a-8a18-409f-a38d-e81141fc9e42 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:37.999340 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bc38a-8a18-409f-a38d-e81141fc9e42 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:37.999613 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bc38a-8a18-409f-a38d-e81141fc9e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:38.019680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-432bc38a-8a18-409f-a38d-e81141fc9e42 None None] MFA Rules not processed for user `5f36f349d532411ba09da3231aef3f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:38.020894 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-432bc38a-8a18-409f-a38d-e81141fc9e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:38.028633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 539/1091] 10.222.0.60 () {58 vars in 1064 bytes} [Fri Aug 19 19:30:37 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:38.036467 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307ee12-4d7c-4e5b-af39-7fc7c04982f3 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:38.047678 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307ee12-4d7c-4e5b-af39-7fc7c04982f3 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:38.051435 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064d566-11cb-425b-9d42-0b32455fd6f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f36f349d532411ba09da3231aef3f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:38.052030 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064d566-11cb-425b-9d42-0b32455fd6f6 service glance] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:38.052305 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064d566-11cb-425b-9d42-0b32455fd6f6 service glance] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:38.052576 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064d566-11cb-425b-9d42-0b32455fd6f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:38.062775 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064d566-11cb-425b-9d42-0b32455fd6f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:38.064214 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064d566-11cb-425b-9d42-0b32455fd6f6 service glance] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:38.074140 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 553/1092] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:40.344297 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b0b05-e1b8-4cd0-ace6-b28a051cf0c2 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:40.344851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b0b05-e1b8-4cd0-ace6-b28a051cf0c2 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:40.344851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b0b05-e1b8-4cd0-ace6-b28a051cf0c2 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:40.346251 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 540/1093] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:40.351786 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe9ebc-214a-461b-b557-218b2cd06721 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:40.352241 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe9ebc-214a-461b-b557-218b2cd06721 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:40.352356 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe9ebc-214a-461b-b557-218b2cd06721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:40.373380 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-b0fe9ebc-214a-461b-b557-218b2cd06721 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:40.374634 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-b0fe9ebc-214a-461b-b557-218b2cd06721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:40.383069 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 554/1094] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:30:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:30:40.708257 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b0b05-e1b8-4cd0-ace6-b28a051cf0c2 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:40.723225 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b0b05-e1b8-4cd0-ace6-b28a051cf0c2 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:40.729155 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00e6f0-7141-4f78-87d4-c6b3b8f000bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:40.729761 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e6f0-7141-4f78-87d4-c6b3b8f000bb admin admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:40.730026 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e6f0-7141-4f78-87d4-c6b3b8f000bb admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:40.730312 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e6f0-7141-4f78-87d4-c6b3b8f000bb admin admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:40.730943 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00e6f0-7141-4f78-87d4-c6b3b8f000bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:40.732699 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: WARNING py.warnings [None req-5b00e6f0-7141-4f78-87d4-c6b3b8f000bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:30:40.732699 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: warnings.warn(msg) Aug 19 19:30:40.732699 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: Aug 19 19:30:40.733848 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00e6f0-7141-4f78-87d4-c6b3b8f000bb admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:40.752202 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 541/1095] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 19:30:40 2022] GET /identity/v3/projects => generated 1606 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:30:42.955565 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01ce32-1a18-457e-9e94-4df7266f372c None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:42.956236 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01ce32-1a18-457e-9e94-4df7266f372c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:42.956236 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01ce32-1a18-457e-9e94-4df7266f372c None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:42.957480 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 555/1096] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:42.964463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade79cd-eb4d-48b2-971d-b95047b6d73c None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:42.965477 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade79cd-eb4d-48b2-971d-b95047b6d73c None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:42.965932 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade79cd-eb4d-48b2-971d-b95047b6d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:42.992415 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-9ade79cd-eb4d-48b2-971d-b95047b6d73c None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:42.993637 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-9ade79cd-eb4d-48b2-971d-b95047b6d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:43.003293 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 542/1097] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:30:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:43.351448 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01ce32-1a18-457e-9e94-4df7266f372c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:43.373175 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01ce32-1a18-457e-9e94-4df7266f372c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:43.379261 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e1a27-d63e-454d-94f0-5d73aa95336d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:43.379869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1a27-d63e-454d-94f0-5d73aa95336d service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:43.380118 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1a27-d63e-454d-94f0-5d73aa95336d service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:43.380423 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1a27-d63e-454d-94f0-5d73aa95336d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:43.389439 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e1a27-d63e-454d-94f0-5d73aa95336d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:43.391066 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e1a27-d63e-454d-94f0-5d73aa95336d service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:43.400725 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 556/1098] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:45.799008 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1c536-52e1-4a30-ac93-b02d4d1cafa0 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:45.799615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1c536-52e1-4a30-ac93-b02d4d1cafa0 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:45.799615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1c536-52e1-4a30-ac93-b02d4d1cafa0 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:45.801574 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 543/1099] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:30:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:45.809826 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f0865-2acd-4764-be9a-71897f9e5528 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:45.810289 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f0865-2acd-4764-be9a-71897f9e5528 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:45.810399 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f0865-2acd-4764-be9a-71897f9e5528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:45.834891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-ae2f0865-2acd-4764-be9a-71897f9e5528 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:45.836078 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-ae2f0865-2acd-4764-be9a-71897f9e5528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:45.845531 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 557/1100] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:30:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:46.196247 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1c536-52e1-4a30-ac93-b02d4d1cafa0 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:46.210660 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1c536-52e1-4a30-ac93-b02d4d1cafa0 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:46.215898 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c7efc-31cf-4344-b15e-0c26477fdbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:46.216494 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c7efc-31cf-4344-b15e-0c26477fdbdb service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:46.216768 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c7efc-31cf-4344-b15e-0c26477fdbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:46.217041 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c7efc-31cf-4344-b15e-0c26477fdbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:46.226751 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c7efc-31cf-4344-b15e-0c26477fdbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:46.228354 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c7efc-31cf-4344-b15e-0c26477fdbdb service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:46.237874 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 544/1101] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:48.500519 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616417-aef2-4eb5-a3ec-56866e1872b8 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:48.501051 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616417-aef2-4eb5-a3ec-56866e1872b8 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:48.501051 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616417-aef2-4eb5-a3ec-56866e1872b8 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:48.502531 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 558/1102] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:48.507894 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75440b2-7ab6-4a5d-a1ff-d8d73c753269 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:48.508328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75440b2-7ab6-4a5d-a1ff-d8d73c753269 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:48.508442 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75440b2-7ab6-4a5d-a1ff-d8d73c753269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:48.528665 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-a75440b2-7ab6-4a5d-a1ff-d8d73c753269 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:48.530094 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-a75440b2-7ab6-4a5d-a1ff-d8d73c753269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:48.540307 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 545/1103] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:30:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:48.887005 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73616417-aef2-4eb5-a3ec-56866e1872b8 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:48.899711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73616417-aef2-4eb5-a3ec-56866e1872b8 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:48.904690 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9559e-ca30-4188-96ae-56833c43969c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:48.905294 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9559e-ca30-4188-96ae-56833c43969c service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:48.905570 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9559e-ca30-4188-96ae-56833c43969c service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:48.905842 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9559e-ca30-4188-96ae-56833c43969c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:48.916626 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9559e-ca30-4188-96ae-56833c43969c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:48.918103 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9559e-ca30-4188-96ae-56833c43969c service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:48.927894 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 559/1104] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:51.325591 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c37b7-6952-4cc3-82e2-c7a696d0c3a1 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:51.326181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c37b7-6952-4cc3-82e2-c7a696d0c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:51.326181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c37b7-6952-4cc3-82e2-c7a696d0c3a1 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:51.327474 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 546/1105] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:51.333028 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a21709-776c-419c-9802-a93cbe2c3219 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:51.333473 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a21709-776c-419c-9802-a93cbe2c3219 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:51.333642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a21709-776c-419c-9802-a93cbe2c3219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:51.354912 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-f0a21709-776c-419c-9802-a93cbe2c3219 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:51.356224 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-f0a21709-776c-419c-9802-a93cbe2c3219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:51.364982 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 560/1106] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:30:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:51.717004 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c37b7-6952-4cc3-82e2-c7a696d0c3a1 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:51.729046 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c37b7-6952-4cc3-82e2-c7a696d0c3a1 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:51.732740 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7be968-f1da-4e48-90f5-9f032f66b36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:51.733428 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7be968-f1da-4e48-90f5-9f032f66b36e service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:51.733709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7be968-f1da-4e48-90f5-9f032f66b36e service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:51.733978 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7be968-f1da-4e48-90f5-9f032f66b36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:51.745009 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7be968-f1da-4e48-90f5-9f032f66b36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:51.746511 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7be968-f1da-4e48-90f5-9f032f66b36e service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:51.756519 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 547/1107] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:54.287904 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db080d7-ef71-40be-8d26-8ca5934701d2 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:54.288503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db080d7-ef71-40be-8d26-8ca5934701d2 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:54.288503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db080d7-ef71-40be-8d26-8ca5934701d2 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:54.289845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 561/1108] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 19:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:54.296275 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc59c-57b9-4df2-96a5-3e0132837f8d None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:54.296690 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc59c-57b9-4df2-96a5-3e0132837f8d None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:54.297128 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc59c-57b9-4df2-96a5-3e0132837f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:54.326383 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-c1abc59c-57b9-4df2-96a5-3e0132837f8d None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:54.328540 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-c1abc59c-57b9-4df2-96a5-3e0132837f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:54.342563 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 548/1109] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 19:30:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:54.711328 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db080d7-ef71-40be-8d26-8ca5934701d2 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:54.722825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db080d7-ef71-40be-8d26-8ca5934701d2 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:54.726402 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2f49-4f1b-41e8-94d2-98359989404a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:54.726998 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2f49-4f1b-41e8-94d2-98359989404a service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:54.727273 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2f49-4f1b-41e8-94d2-98359989404a service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:54.727542 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2f49-4f1b-41e8-94d2-98359989404a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:54.736912 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2f49-4f1b-41e8-94d2-98359989404a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:54.738595 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2f49-4f1b-41e8-94d2-98359989404a service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:54.748626 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 562/1110] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:31:04.319891 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=33 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:31:04.744312 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=33 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:32:08.803144 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d0a2e-4cbb-411b-a267-7f4cf86f4ebd None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:08.803842 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d0a2e-4cbb-411b-a267-7f4cf86f4ebd None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:08.803842 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d0a2e-4cbb-411b-a267-7f4cf86f4ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:08.826036 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-790d0a2e-4cbb-411b-a267-7f4cf86f4ebd None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:32:08.827444 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-790d0a2e-4cbb-411b-a267-7f4cf86f4ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:32:08.837857 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 549/1111] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:32:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:32:08.846952 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67ff0-180c-463f-857a-22cf19709c60 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:08.847818 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67ff0-180c-463f-857a-22cf19709c60 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:08.847818 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67ff0-180c-463f-857a-22cf19709c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:08.876232 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-fcb67ff0-180c-463f-857a-22cf19709c60 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:32:08.877449 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-fcb67ff0-180c-463f-857a-22cf19709c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:32:08.887162 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 563/1112] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:32:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:32:08.891722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d0a2e-4cbb-411b-a267-7f4cf86f4ebd None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:32:08.902015 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d0a2e-4cbb-411b-a267-7f4cf86f4ebd None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:32:08.907581 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565482d4-18e9-4f0f-8eb0-bed1fcfb0646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:32:08.908643 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565482d4-18e9-4f0f-8eb0-bed1fcfb0646 admin admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:08.908864 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565482d4-18e9-4f0f-8eb0-bed1fcfb0646 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:08.909045 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565482d4-18e9-4f0f-8eb0-bed1fcfb0646 admin admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:08.909712 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565482d4-18e9-4f0f-8eb0-bed1fcfb0646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:32:08.910033 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565482d4-18e9-4f0f-8eb0-bed1fcfb0646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:32:08.911077 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: WARNING py.warnings [None req-565482d4-18e9-4f0f-8eb0-bed1fcfb0646 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:32:08.911077 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: warnings.warn(msg) Aug 19 19:32:08.911077 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: Aug 19 19:32:08.911975 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565482d4-18e9-4f0f-8eb0-bed1fcfb0646 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:32:08.924196 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 550/1113] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Aug 19 19:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:32:08.932852 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb67ff0-180c-463f-857a-22cf19709c60 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:32:08.942347 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb67ff0-180c-463f-857a-22cf19709c60 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:32:08.947247 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebe11b-6d0e-4337-b2fa-1277f1b4a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:32:08.947844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebe11b-6d0e-4337-b2fa-1277f1b4a537 admin admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:08.948122 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebe11b-6d0e-4337-b2fa-1277f1b4a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:08.948386 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebe11b-6d0e-4337-b2fa-1277f1b4a537 admin admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:08.949013 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebe11b-6d0e-4337-b2fa-1277f1b4a537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:32:08.950837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: WARNING py.warnings [None req-53ebe11b-6d0e-4337-b2fa-1277f1b4a537 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:32:08.950837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: warnings.warn(msg) Aug 19 19:32:08.950837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: Aug 19 19:32:08.952055 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebe11b-6d0e-4337-b2fa-1277f1b4a537 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:32:08.983463 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 564/1114] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Aug 19 19:32:08 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:32:08.987710 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565482d4-18e9-4f0f-8eb0-bed1fcfb0646 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:32:08.998113 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565482d4-18e9-4f0f-8eb0-bed1fcfb0646 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:32:09.066212 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc49a6d-7ed6-4fdd-a585-371367eacd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:32:09.066871 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc49a6d-7ed6-4fdd-a585-371367eacd74 admin admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.067211 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc49a6d-7ed6-4fdd-a585-371367eacd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.067462 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc49a6d-7ed6-4fdd-a585-371367eacd74 admin admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.068182 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc49a6d-7ed6-4fdd-a585-371367eacd74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:32:09.069545 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: WARNING py.warnings [None req-5bc49a6d-7ed6-4fdd-a585-371367eacd74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:32:09.069545 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: warnings.warn(msg) Aug 19 19:32:09.069545 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: Aug 19 19:32:09.070780 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc49a6d-7ed6-4fdd-a585-371367eacd74 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:32:09.095257 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 551/1115] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:32:08 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:32:09.099726 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebe11b-6d0e-4337-b2fa-1277f1b4a537 admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:32:09.110893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebe11b-6d0e-4337-b2fa-1277f1b4a537 admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:32:09.116709 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7802c0d-1804-4767-9532-ad4f88181085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:32:09.117317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802c0d-1804-4767-9532-ad4f88181085 admin admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.117725 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802c0d-1804-4767-9532-ad4f88181085 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.118028 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802c0d-1804-4767-9532-ad4f88181085 admin admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.118656 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7802c0d-1804-4767-9532-ad4f88181085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:32:09.119688 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: WARNING py.warnings [None req-c7802c0d-1804-4767-9532-ad4f88181085 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:32:09.119688 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: warnings.warn(msg) Aug 19 19:32:09.119688 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: Aug 19 19:32:09.120566 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7802c0d-1804-4767-9532-ad4f88181085 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:32:09.133585 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 565/1116] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 19:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:32:09.138028 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc49a6d-7ed6-4fdd-a585-371367eacd74 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:32:09.148121 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc49a6d-7ed6-4fdd-a585-371367eacd74 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:32:09.153107 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6153ee4-3c89-4ea1-b99b-e828e8da5ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:32:09.153711 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6153ee4-3c89-4ea1-b99b-e828e8da5ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.153981 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6153ee4-3c89-4ea1-b99b-e828e8da5ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.154278 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6153ee4-3c89-4ea1-b99b-e828e8da5ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.154904 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6153ee4-3c89-4ea1-b99b-e828e8da5ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:32:09.155901 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: WARNING py.warnings [None req-a6153ee4-3c89-4ea1-b99b-e828e8da5ef5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:32:09.155901 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: warnings.warn(msg) Aug 19 19:32:09.155901 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: Aug 19 19:32:09.156780 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6153ee4-3c89-4ea1-b99b-e828e8da5ef5 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:32:09.170426 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 552/1117] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 19:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:32:09.176719 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7802c0d-1804-4767-9532-ad4f88181085 admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:32:09.191353 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7802c0d-1804-4767-9532-ad4f88181085 admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:32:09.197460 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797ad56-6ca9-4708-88aa-1980ff78168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:32:09.197924 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797ad56-6ca9-4708-88aa-1980ff78168a admin admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.198230 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797ad56-6ca9-4708-88aa-1980ff78168a admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.198501 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797ad56-6ca9-4708-88aa-1980ff78168a admin admin] PATH_INFO: `/v3/projects/6d8b0cc3e71f487e84bca9620f61feeb/users/79b70e62ecd84016a2f62066ec2102f7/roles/848a48b503dc483fbbc428affa473937` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.215099 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797ad56-6ca9-4708-88aa-1980ff78168a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8b0cc3e71f487e84bca9620f61feeb, user_id=79b70e62ecd84016a2f62066ec2102f7, role_id=848a48b503dc483fbbc428affa473937)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:32:09.216154 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: WARNING py.warnings [None req-b797ad56-6ca9-4708-88aa-1980ff78168a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:32:09.216154 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: warnings.warn(msg) Aug 19 19:32:09.216154 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: Aug 19 19:32:09.218109 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797ad56-6ca9-4708-88aa-1980ff78168a admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:32:09.235153 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 566/1118] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 19:32:09 2022] PUT /identity/v3/projects/6d8b0cc3e71f487e84bca9620f61feeb/users/79b70e62ecd84016a2f62066ec2102f7/roles/848a48b503dc483fbbc428affa473937 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:32:09.247780 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be9f48-23a5-4c07-8ee9-fc58f77b2505 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.248078 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be9f48-23a5-4c07-8ee9-fc58f77b2505 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.248348 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be9f48-23a5-4c07-8ee9-fc58f77b2505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.277725 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-e4be9f48-23a5-4c07-8ee9-fc58f77b2505 None None] MFA Rules not processed for user `79b70e62ecd84016a2f62066ec2102f7`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:32:09.279043 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-e4be9f48-23a5-4c07-8ee9-fc58f77b2505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:32:09.349652 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 553/1119] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:32:09 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:32:09.370535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206534b0-5a85-4e42-8a75-888f0687f86c None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.370825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206534b0-5a85-4e42-8a75-888f0687f86c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.371101 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206534b0-5a85-4e42-8a75-888f0687f86c None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.373459 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 567/1120] 10.222.0.60 () {54 vars in 964 bytes} [Fri Aug 19 19:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:32:09.380384 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d829-a1ab-4ce6-8cfb-07272cad4c58 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.380685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d829-a1ab-4ce6-8cfb-07272cad4c58 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.381094 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d829-a1ab-4ce6-8cfb-07272cad4c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.408878 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-0560d829-a1ab-4ce6-8cfb-07272cad4c58 None None] MFA Rules not processed for user `d19d16bc47614980b4f6d57e39a0f4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:32:09.410258 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-0560d829-a1ab-4ce6-8cfb-07272cad4c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:32:09.456610 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:32:09.466709 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 554/1121] 10.222.0.60 () {58 vars in 1061 bytes} [Fri Aug 19 19:32:09 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:32:09.474340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206534b0-5a85-4e42-8a75-888f0687f86c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:32:09.485797 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206534b0-5a85-4e42-8a75-888f0687f86c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:32:09.489746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68a0bc-1260-4035-97f7-2e0e11f02c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd19d16bc47614980b4f6d57e39a0f4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:32:09.490391 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68a0bc-1260-4035-97f7-2e0e11f02c11 service cinder] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.490665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68a0bc-1260-4035-97f7-2e0e11f02c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.490925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68a0bc-1260-4035-97f7-2e0e11f02c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.501205 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68a0bc-1260-4035-97f7-2e0e11f02c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:32:09.502686 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68a0bc-1260-4035-97f7-2e0e11f02c11 service cinder] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:32:09.513265 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 568/1122] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:32:09 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:32:09.553049 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e84d-ad5b-4449-bcf8-93480397a2aa None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.553429 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e84d-ad5b-4449-bcf8-93480397a2aa None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.553712 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e84d-ad5b-4449-bcf8-93480397a2aa None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.555029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 555/1123] 10.222.0.60 () {52 vars in 830 bytes} [Fri Aug 19 19:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:32:09.558822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68a0bc-1260-4035-97f7-2e0e11f02c11 service cinder] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:32:09.623822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68a0bc-1260-4035-97f7-2e0e11f02c11 service cinder] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:32:09.628931 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:32:09.629556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.629835 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.630144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] PATH_INFO: `/v3/users/79b70e62ecd84016a2f62066ec2102f7` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.631310 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b70e62ecd84016a2f62066ec2102f7)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:32:09.632340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: WARNING py.warnings [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:32:09.632340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: warnings.warn(msg) Aug 19 19:32:09.632340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: Aug 19 19:32:09.633552 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:32:09.704824 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b70e62ecd84016a2f62066ec2102f7'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:32:09.731251 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b70e62ecd84016a2f62066ec2102f7'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:32:09.732025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b70e62ecd84016a2f62066ec2102f7'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:32:09.732883 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b70e62ecd84016a2f62066ec2102f7'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:32:09.749355 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b70e62ecd84016a2f62066ec2102f7'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:32:09.766159 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 569/1124] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Aug 19 19:32:09 2022] DELETE /identity/v3/users/79b70e62ecd84016a2f62066ec2102f7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:32:09.770696 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fce6d7-46f9-4e6b-a862-4c1af9a05897 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.771005 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fce6d7-46f9-4e6b-a862-4c1af9a05897 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.771270 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fce6d7-46f9-4e6b-a862-4c1af9a05897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.791430 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-73fce6d7-46f9-4e6b-a862-4c1af9a05897 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:32:09.792646 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-73fce6d7-46f9-4e6b-a862-4c1af9a05897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:32:09.856311 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 556/1125] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:32:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:32:09.867064 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:32:09.868793 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:32:09.874986 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:32:09.931919 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e018c58-f052-4209-8347-cc5b327856fe admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:32:09.935945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8001ea-2616-4603-8f2d-63e38124719d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:32:09.936559 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8001ea-2616-4603-8f2d-63e38124719d service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.936839 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8001ea-2616-4603-8f2d-63e38124719d service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.937104 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8001ea-2616-4603-8f2d-63e38124719d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.946494 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8001ea-2616-4603-8f2d-63e38124719d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:32:09.948019 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8001ea-2616-4603-8f2d-63e38124719d service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:32:09.957480 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 570/1126] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:32:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:32:10.301468 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fce6d7-46f9-4e6b-a862-4c1af9a05897 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:32:10.303234 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-73fce6d7-46f9-4e6b-a862-4c1af9a05897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:32:10.316571 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fce6d7-46f9-4e6b-a862-4c1af9a05897 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:32:10.323324 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:32:10.324054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:10.324230 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:10.324501 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] PATH_INFO: `/v3/projects/6d8b0cc3e71f487e84bca9620f61feeb` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:10.326441 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8b0cc3e71f487e84bca9620f61feeb)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:32:10.327676 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: WARNING py.warnings [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:32:10.327676 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: warnings.warn(msg) Aug 19 19:32:10.327676 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: Aug 19 19:32:10.328887 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:32:10.393407 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8b0cc3e71f487e84bca9620f61feeb', 'request_id': 'req-0f24a243-0976-40d5-8637-9e69758f5fbd'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:32:10.410385 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8b0cc3e71f487e84bca9620f61feeb', 'request_id': 'req-0f24a243-0976-40d5-8637-9e69758f5fbd'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:32:10.421738 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8b0cc3e71f487e84bca9620f61feeb', 'request_id': 'req-0f24a243-0976-40d5-8637-9e69758f5fbd'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:32:10.433673 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] The token cache is being invalidate because project 6d8b0cc3e71f487e84bca9620f61feeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=123563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 19:32:10.433959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:32:10.434610 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-0f24a243-0976-40d5-8637-9e69758f5fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:32:10.436174 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 557/1127] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Aug 19 19:32:10 2022] DELETE /identity/v3/projects/6d8b0cc3e71f487e84bca9620f61feeb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:32:19.953532 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=25 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:32:20.429977 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:33:30.634134 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2844b-6a69-44c8-940e-8524c265734c None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:30.634994 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2844b-6a69-44c8-940e-8524c265734c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:30.634994 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2844b-6a69-44c8-940e-8524c265734c None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:30.636111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 571/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:33:30.642283 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e40733-f298-4dd9-90c8-23dabeb39a27 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:30.643073 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e40733-f298-4dd9-90c8-23dabeb39a27 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:30.643073 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e40733-f298-4dd9-90c8-23dabeb39a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:30.718418 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-c1e40733-f298-4dd9-90c8-23dabeb39a27 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:33:30.719645 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-c1e40733-f298-4dd9-90c8-23dabeb39a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:30.824995 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 558/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:33:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:33:30.985050 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2844b-6a69-44c8-940e-8524c265734c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:33:30.986984 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-26f2844b-6a69-44c8-940e-8524c265734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:31.083283 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2844b-6a69-44c8-940e-8524c265734c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:33:31.088663 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3db92f-879d-4aad-b016-5d103f11c82b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:33:31.089266 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3db92f-879d-4aad-b016-5d103f11c82b service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:31.089542 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3db92f-879d-4aad-b016-5d103f11c82b service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:31.089808 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3db92f-879d-4aad-b016-5d103f11c82b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:31.102796 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3db92f-879d-4aad-b016-5d103f11c82b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:33:31.105307 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3db92f-879d-4aad-b016-5d103f11c82b service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:33:31.120008 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 572/1130] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:33:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:33:31.975751 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fcaa7-6869-4b55-9c5d-0c20f85ff4cd None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:31.976678 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fcaa7-6869-4b55-9c5d-0c20f85ff4cd None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:31.976678 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fcaa7-6869-4b55-9c5d-0c20f85ff4cd None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:31.978839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 559/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:33:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:33:31.985241 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be7847-a348-4b1d-8d50-2ca223e78154 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:31.985696 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be7847-a348-4b1d-8d50-2ca223e78154 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:31.985808 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be7847-a348-4b1d-8d50-2ca223e78154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:32.009881 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-51be7847-a348-4b1d-8d50-2ca223e78154 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:33:32.011121 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-51be7847-a348-4b1d-8d50-2ca223e78154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:32.019492 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 573/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:33:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:33:32.191081 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fcaa7-6869-4b55-9c5d-0c20f85ff4cd None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:33:32.207546 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fcaa7-6869-4b55-9c5d-0c20f85ff4cd None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:33:32.213684 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43bb01-dae0-41f5-9f42-e6048cdce290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:33:32.214591 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43bb01-dae0-41f5-9f42-e6048cdce290 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:32.214994 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43bb01-dae0-41f5-9f42-e6048cdce290 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:32.215396 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43bb01-dae0-41f5-9f42-e6048cdce290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:32.224959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43bb01-dae0-41f5-9f42-e6048cdce290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:33:32.226791 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43bb01-dae0-41f5-9f42-e6048cdce290 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:33:32.237415 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 560/1133] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:33:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:33:36.238452 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1670d-23e3-44d5-a2c8-43ad598fd372 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:36.239031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1670d-23e3-44d5-a2c8-43ad598fd372 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:36.239031 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1670d-23e3-44d5-a2c8-43ad598fd372 None None] PATH_INFO: `/v3` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:36.240341 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 574/1134] 10.222.0.43 () {54 vars in 925 bytes} [Fri Aug 19 19:33:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:33:36.247927 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d956-ad55-42f8-8162-c4fe6b65c301 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:36.248405 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d956-ad55-42f8-8162-c4fe6b65c301 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:36.248509 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d956-ad55-42f8-8162-c4fe6b65c301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:36.280904 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-92d2d956-ad55-42f8-8162-c4fe6b65c301 None None] MFA Rules not processed for user `35957952c2a142ba868279f19ab4d46d`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:33:36.282448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-92d2d956-ad55-42f8-8162-c4fe6b65c301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:36.339720 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:33:36.350235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 561/1135] 10.222.0.43 () {58 vars in 1015 bytes} [Fri Aug 19 19:33:36 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:33:42.004982 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=42 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:33:43.537299 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315bae-e82a-4d2f-bcf8-b82f358af84f None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:43.538025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315bae-e82a-4d2f-bcf8-b82f358af84f None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:43.538025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315bae-e82a-4d2f-bcf8-b82f358af84f None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:43.539231 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 575/1136] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:33:43.544565 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d78bf-868c-4ec2-8438-c268e696ced8 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:43.545065 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d78bf-868c-4ec2-8438-c268e696ced8 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:43.545163 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d78bf-868c-4ec2-8438-c268e696ced8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:43.567024 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-b01d78bf-868c-4ec2-8438-c268e696ced8 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:33:43.568357 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-b01d78bf-868c-4ec2-8438-c268e696ced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:43.578094 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 562/1137] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:33:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:33:43.742148 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93315bae-e82a-4d2f-bcf8-b82f358af84f None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:33:43.758854 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93315bae-e82a-4d2f-bcf8-b82f358af84f None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:33:43.765326 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ddbf3-c25e-4b67-b295-62d0e5f97f7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:33:43.765928 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ddbf3-c25e-4b67-b295-62d0e5f97f7a service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:43.766267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ddbf3-c25e-4b67-b295-62d0e5f97f7a service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:43.766537 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ddbf3-c25e-4b67-b295-62d0e5f97f7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:43.774934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ddbf3-c25e-4b67-b295-62d0e5f97f7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:33:43.776521 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ddbf3-c25e-4b67-b295-62d0e5f97f7a service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:33:43.787527 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 576/1138] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:33:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:33:44.644884 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182790bc-6586-4dd9-8d71-67dbfb70e891 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:44.645505 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182790bc-6586-4dd9-8d71-67dbfb70e891 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:44.645505 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182790bc-6586-4dd9-8d71-67dbfb70e891 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:44.646820 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 563/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:33:44.653235 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af591aa3-ddce-4379-8091-64253b158bf5 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:44.654261 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af591aa3-ddce-4379-8091-64253b158bf5 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:44.654261 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af591aa3-ddce-4379-8091-64253b158bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:44.687550 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-af591aa3-ddce-4379-8091-64253b158bf5 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:33:44.689594 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-af591aa3-ddce-4379-8091-64253b158bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:44.698631 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 577/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:33:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:33:44.877562 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182790bc-6586-4dd9-8d71-67dbfb70e891 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:33:44.895121 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182790bc-6586-4dd9-8d71-67dbfb70e891 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:33:44.901293 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43791-199b-4911-befe-609e461cc1a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:33:44.901890 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43791-199b-4911-befe-609e461cc1a6 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:44.902189 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43791-199b-4911-befe-609e461cc1a6 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:44.902458 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43791-199b-4911-befe-609e461cc1a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:44.911669 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f43791-199b-4911-befe-609e461cc1a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:33:44.913245 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f43791-199b-4911-befe-609e461cc1a6 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:33:44.922902 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 564/1141] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:33:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:33:45.647262 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d55373-40c6-4b0a-b711-a610c865eb94 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:45.647651 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d55373-40c6-4b0a-b711-a610c865eb94 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:45.648124 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d55373-40c6-4b0a-b711-a610c865eb94 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:45.650408 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 578/1142] 10.222.0.60 () {54 vars in 961 bytes} [Fri Aug 19 19:33:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:33:45.658054 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7e5b-e9a9-4c6c-9ddf-3293061740f5 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:45.658585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7e5b-e9a9-4c6c-9ddf-3293061740f5 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:45.658585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7e5b-e9a9-4c6c-9ddf-3293061740f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:45.678964 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-017b7e5b-e9a9-4c6c-9ddf-3293061740f5 None None] MFA Rules not processed for user `35957952c2a142ba868279f19ab4d46d`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:33:45.680159 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-017b7e5b-e9a9-4c6c-9ddf-3293061740f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:45.689484 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 565/1143] 10.222.0.60 () {58 vars in 1058 bytes} [Fri Aug 19 19:33:45 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:33:45.762313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d55373-40c6-4b0a-b711-a610c865eb94 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:33:45.785555 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d55373-40c6-4b0a-b711-a610c865eb94 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:33:45.794849 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215f5ac-2871-409e-a292-cd4a1bffde9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35957952c2a142ba868279f19ab4d46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:33:45.795457 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215f5ac-2871-409e-a292-cd4a1bffde9a service placement] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:45.795728 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215f5ac-2871-409e-a292-cd4a1bffde9a service placement] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:45.795989 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215f5ac-2871-409e-a292-cd4a1bffde9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:45.804934 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215f5ac-2871-409e-a292-cd4a1bffde9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:33:45.806563 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215f5ac-2871-409e-a292-cd4a1bffde9a service placement] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:33:45.816560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 579/1144] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:33:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:33:49.092301 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572646de-6ac1-4c77-bfc8-33bb063f2b81 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:49.093322 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572646de-6ac1-4c77-bfc8-33bb063f2b81 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:49.093322 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572646de-6ac1-4c77-bfc8-33bb063f2b81 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:49.095321 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 566/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:33:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:33:49.104038 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54202ac-ee1f-4755-b4d5-cc13ad5a439c None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:49.104815 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54202ac-ee1f-4755-b4d5-cc13ad5a439c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:49.104995 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54202ac-ee1f-4755-b4d5-cc13ad5a439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:49.131481 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-d54202ac-ee1f-4755-b4d5-cc13ad5a439c None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:33:49.132691 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-d54202ac-ee1f-4755-b4d5-cc13ad5a439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:49.143325 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 580/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:33:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:33:49.490252 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572646de-6ac1-4c77-bfc8-33bb063f2b81 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:33:49.492576 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-572646de-6ac1-4c77-bfc8-33bb063f2b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:49.554320 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572646de-6ac1-4c77-bfc8-33bb063f2b81 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:33:49.558318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5e7d5-e97e-4f83-a8ca-07daa645c37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:33:49.558976 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e7d5-e97e-4f83-a8ca-07daa645c37e service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:49.559443 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e7d5-e97e-4f83-a8ca-07daa645c37e service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:49.559802 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e7d5-e97e-4f83-a8ca-07daa645c37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:49.569187 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5e7d5-e97e-4f83-a8ca-07daa645c37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:33:49.570870 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5e7d5-e97e-4f83-a8ca-07daa645c37e service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:33:49.581749 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 567/1147] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:33:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:33:51.778928 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcae42-24e3-45be-a3bc-7dd6f9a8e6d6 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:51.779498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcae42-24e3-45be-a3bc-7dd6f9a8e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:51.779498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcae42-24e3-45be-a3bc-7dd6f9a8e6d6 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:51.781937 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 581/1148] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:33:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:33:51.789840 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea8008-7828-4b0f-9ede-2cb37e7980b6 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:51.790349 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea8008-7828-4b0f-9ede-2cb37e7980b6 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:51.790475 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea8008-7828-4b0f-9ede-2cb37e7980b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:51.811979 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-e7ea8008-7828-4b0f-9ede-2cb37e7980b6 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:33:51.813174 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-e7ea8008-7828-4b0f-9ede-2cb37e7980b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:51.826575 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 568/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:33:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:33:52.168226 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcae42-24e3-45be-a3bc-7dd6f9a8e6d6 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:33:52.185754 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcae42-24e3-45be-a3bc-7dd6f9a8e6d6 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:33:52.190857 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcca7b-b233-4009-bb95-468244b859f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:33:52.191472 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcca7b-b233-4009-bb95-468244b859f7 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:52.191711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcca7b-b233-4009-bb95-468244b859f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:52.192013 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcca7b-b233-4009-bb95-468244b859f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:52.205427 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcca7b-b233-4009-bb95-468244b859f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:33:52.206913 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcca7b-b233-4009-bb95-468244b859f7 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:33:52.217805 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 582/1150] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:33:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:33:56.007328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ab9c-ec72-4508-aaaa-b8e32f8826eb None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:56.007926 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ab9c-ec72-4508-aaaa-b8e32f8826eb None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:56.007926 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ab9c-ec72-4508-aaaa-b8e32f8826eb None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:56.009918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 569/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:33:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:33:56.018678 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01928e77-eeba-4e7f-be69-d22ebe21ef30 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:56.019431 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01928e77-eeba-4e7f-be69-d22ebe21ef30 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:56.019606 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01928e77-eeba-4e7f-be69-d22ebe21ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:56.044597 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-01928e77-eeba-4e7f-be69-d22ebe21ef30 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:33:56.045822 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-01928e77-eeba-4e7f-be69-d22ebe21ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:56.055258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 583/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:33:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:33:56.649822 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257ab9c-ec72-4508-aaaa-b8e32f8826eb None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:33:56.651892 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-d257ab9c-ec72-4508-aaaa-b8e32f8826eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:56.711468 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257ab9c-ec72-4508-aaaa-b8e32f8826eb None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:33:56.715376 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a2052-2594-4f15-a2c4-3eb826e511f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd19d16bc47614980b4f6d57e39a0f4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:33:56.715979 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a2052-2594-4f15-a2c4-3eb826e511f1 service cinder] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:56.716352 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a2052-2594-4f15-a2c4-3eb826e511f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:56.716634 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a2052-2594-4f15-a2c4-3eb826e511f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:56.729827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a2052-2594-4f15-a2c4-3eb826e511f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:33:56.731284 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a2052-2594-4f15-a2c4-3eb826e511f1 service cinder] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:33:56.741649 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 570/1153] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:33:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:33:58.957642 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3c26-ab6e-4c99-8c43-ae307e0820c8 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:58.958341 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3c26-ab6e-4c99-8c43-ae307e0820c8 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:58.958341 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3c26-ab6e-4c99-8c43-ae307e0820c8 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:58.959552 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 584/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:33:58.968132 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c77ce9-98bc-44b4-9803-a425c7bbad2f None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:58.968613 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c77ce9-98bc-44b4-9803-a425c7bbad2f None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:58.968720 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c77ce9-98bc-44b4-9803-a425c7bbad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:58.989055 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-87c77ce9-98bc-44b4-9803-a425c7bbad2f None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:33:58.990319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-87c77ce9-98bc-44b4-9803-a425c7bbad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:58.998829 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 571/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:33:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:33:59.569781 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a3c26-ab6e-4c99-8c43-ae307e0820c8 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:33:59.572565 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-a72a3c26-ab6e-4c99-8c43-ae307e0820c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:59.593043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a3c26-ab6e-4c99-8c43-ae307e0820c8 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:33:59.597473 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac994f8-a92c-45c3-9742-2d1c983b4c98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd19d16bc47614980b4f6d57e39a0f4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:33:59.598096 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac994f8-a92c-45c3-9742-2d1c983b4c98 service cinder] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:59.598367 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac994f8-a92c-45c3-9742-2d1c983b4c98 service cinder] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:59.598630 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac994f8-a92c-45c3-9742-2d1c983b4c98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:59.607958 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac994f8-a92c-45c3-9742-2d1c983b4c98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:33:59.609383 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac994f8-a92c-45c3-9742-2d1c983b4c98 service cinder] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:33:59.618798 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 585/1156] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:33:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:34:08.983983 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=70 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:34:09.614824 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=33 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:13.730049 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709af8a-1791-4567-b96b-33e09755fdab None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:13.730780 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709af8a-1791-4567-b96b-33e09755fdab None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:13.730780 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709af8a-1791-4567-b96b-33e09755fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:13.751299 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-5709af8a-1791-4567-b96b-33e09755fdab None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:13.752624 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-5709af8a-1791-4567-b96b-33e09755fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:13.761304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 572/1157] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:35:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:13.767113 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc420f-02c9-4fdc-aaaa-f0aa94e58469 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:13.767756 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc420f-02c9-4fdc-aaaa-f0aa94e58469 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:13.767756 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc420f-02c9-4fdc-aaaa-f0aa94e58469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:13.769550 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246775f-f6b1-46c1-a1fd-c929932ec9fc None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:13.769834 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246775f-f6b1-46c1-a1fd-c929932ec9fc None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:13.770522 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246775f-f6b1-46c1-a1fd-c929932ec9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:13.789501 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-85bc420f-02c9-4fdc-aaaa-f0aa94e58469 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:13.790827 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-85bc420f-02c9-4fdc-aaaa-f0aa94e58469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:13.794839 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-3246775f-f6b1-46c1-a1fd-c929932ec9fc None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:13.796233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-3246775f-f6b1-46c1-a1fd-c929932ec9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:13.802496 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 586/1158] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:35:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:13.810187 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 573/1159] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:35:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:13.810470 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dc89a-040e-46e5-8390-963aa205eef1 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:13.811511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dc89a-040e-46e5-8390-963aa205eef1 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:13.811511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dc89a-040e-46e5-8390-963aa205eef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:13.812319 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246775f-f6b1-46c1-a1fd-c929932ec9fc None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:13.822193 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246775f-f6b1-46c1-a1fd-c929932ec9fc None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:13.826830 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e23f7-cf63-442e-9e11-f8a1c1d4e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:13.827422 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e23f7-cf63-442e-9e11-f8a1c1d4e044 admin admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:13.827695 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e23f7-cf63-442e-9e11-f8a1c1d4e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:13.827992 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e23f7-cf63-442e-9e11-f8a1c1d4e044 admin admin] PATH_INFO: `/v3/domains` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:13.828631 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e23f7-cf63-442e-9e11-f8a1c1d4e044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=123563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:35:13.828934 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e23f7-cf63-442e-9e11-f8a1c1d4e044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:13.830498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-741dc89a-040e-46e5-8390-963aa205eef1 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:13.830619 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e23f7-cf63-442e-9e11-f8a1c1d4e044 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:13.831704 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-741dc89a-040e-46e5-8390-963aa205eef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:13.840217 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 587/1160] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:35:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:35:13.848152 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 574/1161] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Aug 19 19:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:35:13.848301 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dc89a-040e-46e5-8390-963aa205eef1 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:13.850823 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e23f7-cf63-442e-9e11-f8a1c1d4e044 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:13.854590 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dc89a-040e-46e5-8390-963aa205eef1 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:13.859299 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45855c99-981c-4f0e-be42-4607148733a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:13.859893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855c99-981c-4f0e-be42-4607148733a7 admin admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:13.860168 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855c99-981c-4f0e-be42-4607148733a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:13.860434 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855c99-981c-4f0e-be42-4607148733a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:13.860824 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e23f7-cf63-442e-9e11-f8a1c1d4e044 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:13.861070 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45855c99-981c-4f0e-be42-4607148733a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=123562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:35:13.861368 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45855c99-981c-4f0e-be42-4607148733a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:13.862450 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: WARNING py.warnings [None req-45855c99-981c-4f0e-be42-4607148733a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:35:13.862450 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: warnings.warn(msg) Aug 19 19:35:13.862450 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: Aug 19 19:35:13.863329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45855c99-981c-4f0e-be42-4607148733a7 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:13.866029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b32e2-57a4-4dee-9d85-e25981deec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:13.866953 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b32e2-57a4-4dee-9d85-e25981deec10 admin admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:13.867233 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b32e2-57a4-4dee-9d85-e25981deec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:13.867650 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b32e2-57a4-4dee-9d85-e25981deec10 admin admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:13.868269 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b32e2-57a4-4dee-9d85-e25981deec10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:13.869279 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: WARNING py.warnings [None req-602b32e2-57a4-4dee-9d85-e25981deec10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:35:13.869279 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: warnings.warn(msg) Aug 19 19:35:13.869279 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: Aug 19 19:35:13.870750 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b32e2-57a4-4dee-9d85-e25981deec10 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:13.875761 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 588/1162] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Aug 19 19:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:35:13.883851 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45855c99-981c-4f0e-be42-4607148733a7 admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:13.893788 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45855c99-981c-4f0e-be42-4607148733a7 admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:13.898967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95852ddd-d400-46f3-b276-f7038ca8be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:13.899558 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95852ddd-d400-46f3-b276-f7038ca8be3b admin admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:13.899829 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95852ddd-d400-46f3-b276-f7038ca8be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:13.900128 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95852ddd-d400-46f3-b276-f7038ca8be3b admin admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:13.900754 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95852ddd-d400-46f3-b276-f7038ca8be3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:13.902757 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95852ddd-d400-46f3-b276-f7038ca8be3b admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:13.912903 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 575/1163] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Aug 19 19:35:13 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:35:13.916980 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b32e2-57a4-4dee-9d85-e25981deec10 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:13.934043 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 589/1164] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Aug 19 19:35:13 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:35:13.936157 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95852ddd-d400-46f3-b276-f7038ca8be3b admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:13.979825 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b32e2-57a4-4dee-9d85-e25981deec10 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:13.999169 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95852ddd-d400-46f3-b276-f7038ca8be3b admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:14.003845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4b910-2e7a-4879-94ae-81d5d67fd630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:14.004507 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4b910-2e7a-4879-94ae-81d5d67fd630 admin admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.004779 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4b910-2e7a-4879-94ae-81d5d67fd630 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.005041 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4b910-2e7a-4879-94ae-81d5d67fd630 admin admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.005654 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4b910-2e7a-4879-94ae-81d5d67fd630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:14.006711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: WARNING py.warnings [None req-fed4b910-2e7a-4879-94ae-81d5d67fd630 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:35:14.006711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: warnings.warn(msg) Aug 19 19:35:14.006711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: Aug 19 19:35:14.007915 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4b910-2e7a-4879-94ae-81d5d67fd630 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:14.036040 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 590/1165] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:35:13 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:35:14.037363 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4b910-2e7a-4879-94ae-81d5d67fd630 admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:14.041745 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9218243-a735-48d3-940c-bf94c9dfda36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:14.042393 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9218243-a735-48d3-940c-bf94c9dfda36 admin admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.042664 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9218243-a735-48d3-940c-bf94c9dfda36 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.042930 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9218243-a735-48d3-940c-bf94c9dfda36 admin admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.043562 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9218243-a735-48d3-940c-bf94c9dfda36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:14.045469 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9218243-a735-48d3-940c-bf94c9dfda36 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:14.047056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4b910-2e7a-4879-94ae-81d5d67fd630 admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:14.056495 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f12e16-f48e-4a11-a4e0-d335c6c1d0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:14.057144 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12e16-f48e-4a11-a4e0-d335c6c1d0cb admin admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.057389 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12e16-f48e-4a11-a4e0-d335c6c1d0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.057626 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12e16-f48e-4a11-a4e0-d335c6c1d0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.058301 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f12e16-f48e-4a11-a4e0-d335c6c1d0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:14.059893 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f12e16-f48e-4a11-a4e0-d335c6c1d0cb admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:14.067546 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 576/1166] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:35:13 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:35:14.071629 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9218243-a735-48d3-940c-bf94c9dfda36 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:14.073453 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 591/1167] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 19:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:35:14.077317 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f12e16-f48e-4a11-a4e0-d335c6c1d0cb admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:14.081179 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9218243-a735-48d3-940c-bf94c9dfda36 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:14.085806 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d208012-c476-4f15-8b5e-40176ca78a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:14.086430 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d208012-c476-4f15-8b5e-40176ca78a85 admin admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.086730 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d208012-c476-4f15-8b5e-40176ca78a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.086983 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f12e16-f48e-4a11-a4e0-d335c6c1d0cb admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:14.087138 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d208012-c476-4f15-8b5e-40176ca78a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.087585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d208012-c476-4f15-8b5e-40176ca78a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:14.089191 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d208012-c476-4f15-8b5e-40176ca78a85 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:14.092085 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7fd24-9c65-4a94-82b2-52fb17a82aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:14.092683 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7fd24-9c65-4a94-82b2-52fb17a82aff admin admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.092989 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7fd24-9c65-4a94-82b2-52fb17a82aff admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.093257 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7fd24-9c65-4a94-82b2-52fb17a82aff admin admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.093891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7fd24-9c65-4a94-82b2-52fb17a82aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:14.095507 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7fd24-9c65-4a94-82b2-52fb17a82aff admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:14.099842 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 577/1168] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 19:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:35:14.103726 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d208012-c476-4f15-8b5e-40176ca78a85 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:14.111111 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 592/1169] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 19:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:35:14.112217 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7fd24-9c65-4a94-82b2-52fb17a82aff admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:14.115509 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d208012-c476-4f15-8b5e-40176ca78a85 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:14.120456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba66e7c-f79b-4f89-b0b1-80d74466561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:14.121328 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba66e7c-f79b-4f89-b0b1-80d74466561e admin admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.121729 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba66e7c-f79b-4f89-b0b1-80d74466561e admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.122016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba66e7c-f79b-4f89-b0b1-80d74466561e admin admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.122352 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7fd24-9c65-4a94-82b2-52fb17a82aff admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:14.122701 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba66e7c-f79b-4f89-b0b1-80d74466561e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:14.124310 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba66e7c-f79b-4f89-b0b1-80d74466561e admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:14.127119 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd250f5b-e522-4876-b1da-4e700d0c9181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:14.127750 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250f5b-e522-4876-b1da-4e700d0c9181 admin admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.128023 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250f5b-e522-4876-b1da-4e700d0c9181 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.128286 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250f5b-e522-4876-b1da-4e700d0c9181 admin admin] PATH_INFO: `/v3/projects/472461b3c76443e4bb3f6e527be087fb/users/5f507c90e1b04bb9a3a7bf9ef3802c38/roles/848a48b503dc483fbbc428affa473937` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.135946 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 578/1170] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 19:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:35:14.140228 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba66e7c-f79b-4f89-b0b1-80d74466561e admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:14.144026 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd250f5b-e522-4876-b1da-4e700d0c9181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=472461b3c76443e4bb3f6e527be087fb, user_id=5f507c90e1b04bb9a3a7bf9ef3802c38, role_id=848a48b503dc483fbbc428affa473937)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:14.147360 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd250f5b-e522-4876-b1da-4e700d0c9181 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:14.150597 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba66e7c-f79b-4f89-b0b1-80d74466561e admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:14.157189 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7f4f0-b815-4630-a014-c91851b12562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:14.158053 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f4f0-b815-4630-a014-c91851b12562 admin admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.158333 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f4f0-b815-4630-a014-c91851b12562 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.158605 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f4f0-b815-4630-a014-c91851b12562 admin admin] PATH_INFO: `/v3/projects/42922cbf3a664215b16fc6e5891c8a5a/users/8c01b24b3a214f61acc32686e9ec03d1/roles/848a48b503dc483fbbc428affa473937` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.163811 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 593/1171] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 19:35:14 2022] PUT /identity/v3/projects/472461b3c76443e4bb3f6e527be087fb/users/5f507c90e1b04bb9a3a7bf9ef3802c38/roles/848a48b503dc483fbbc428affa473937 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:35:14.168765 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495415-f07e-4c09-abcf-07a633ac8b83 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.169073 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495415-f07e-4c09-abcf-07a633ac8b83 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.169370 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495415-f07e-4c09-abcf-07a633ac8b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.174252 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7f4f0-b815-4630-a014-c91851b12562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42922cbf3a664215b16fc6e5891c8a5a, user_id=8c01b24b3a214f61acc32686e9ec03d1, role_id=848a48b503dc483fbbc428affa473937)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:14.175289 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: WARNING py.warnings [None req-4ec7f4f0-b815-4630-a014-c91851b12562 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:35:14.175289 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: warnings.warn(msg) Aug 19 19:35:14.175289 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: Aug 19 19:35:14.177213 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7f4f0-b815-4630-a014-c91851b12562 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:14.179613 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:14.188484 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-33495415-f07e-4c09-abcf-07a633ac8b83 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:14.189698 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-33495415-f07e-4c09-abcf-07a633ac8b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:14.191993 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 579/1172] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 19:35:14 2022] PUT /identity/v3/projects/42922cbf3a664215b16fc6e5891c8a5a/users/8c01b24b3a214f61acc32686e9ec03d1/roles/848a48b503dc483fbbc428affa473937 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:35:14.197235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a13f3d-3c2f-4774-a907-e737b4d30e43 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.197235 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a13f3d-3c2f-4774-a907-e737b4d30e43 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.197410 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a13f3d-3c2f-4774-a907-e737b4d30e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.217742 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-a8a13f3d-3c2f-4774-a907-e737b4d30e43 None None] MFA Rules not processed for user `9d26dacccf744cb7a2a26549ace91be1`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:14.218990 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-a8a13f3d-3c2f-4774-a907-e737b4d30e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:14.244150 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:14.257237 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 594/1173] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:35:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:35:14.267622 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33495415-f07e-4c09-abcf-07a633ac8b83 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:14.282353 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 580/1174] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:35:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:35:14.292749 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a13f3d-3c2f-4774-a907-e737b4d30e43 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:14.324343 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33495415-f07e-4c09-abcf-07a633ac8b83 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:14.327955 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36ffeb-394b-4cfe-b053-775006bc92b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:14.328568 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36ffeb-394b-4cfe-b053-775006bc92b5 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.328846 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36ffeb-394b-4cfe-b053-775006bc92b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.329117 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36ffeb-394b-4cfe-b053-775006bc92b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.338526 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36ffeb-394b-4cfe-b053-775006bc92b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:14.339962 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36ffeb-394b-4cfe-b053-775006bc92b5 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:14.347694 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a13f3d-3c2f-4774-a907-e737b4d30e43 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:14.349497 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 595/1175] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:35:14.351692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008e797-f333-499e-929a-a1124e875995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:14.352291 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008e797-f333-499e-929a-a1124e875995 service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:14.352554 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008e797-f333-499e-929a-a1124e875995 service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:14.352818 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008e797-f333-499e-929a-a1124e875995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:14.362438 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008e797-f333-499e-929a-a1124e875995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:14.363982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008e797-f333-499e-929a-a1124e875995 service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:14.374461 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 581/1176] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:35:19.760538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ede9ac-406e-439d-be17-d0d755ead50a None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:19.760538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ede9ac-406e-439d-be17-d0d755ead50a None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:19.760538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ede9ac-406e-439d-be17-d0d755ead50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:19.798778 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-d3ede9ac-406e-439d-be17-d0d755ead50a None None] MFA Rules not processed for user `5f507c90e1b04bb9a3a7bf9ef3802c38`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:19.800358 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-d3ede9ac-406e-439d-be17-d0d755ead50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:19.899660 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 596/1177] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:35:19 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:19.904524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008e797-f333-499e-929a-a1124e875995 service neutron] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:19.915075 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008e797-f333-499e-929a-a1124e875995 service neutron] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:19.921062 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b368-1758-4ad1-9818-98b39a5cc323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:19.921700 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b368-1758-4ad1-9818-98b39a5cc323 admin admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:19.921974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b368-1758-4ad1-9818-98b39a5cc323 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:19.922305 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b368-1758-4ad1-9818-98b39a5cc323 admin admin] PATH_INFO: `/v3/projects` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:19.922933 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812b368-1758-4ad1-9818-98b39a5cc323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:19.930267 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812b368-1758-4ad1-9818-98b39a5cc323 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:19.941016 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8a82b-7da2-4420-b5ff-c1cc507916ed None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:19.941304 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8a82b-7da2-4420-b5ff-c1cc507916ed None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:19.941646 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8a82b-7da2-4420-b5ff-c1cc507916ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:19.983882 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-44e8a82b-7da2-4420-b5ff-c1cc507916ed None None] MFA Rules not processed for user `8c01b24b3a214f61acc32686e9ec03d1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:19.984110 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 582/1178] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Aug 19 19:35:19 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:35:19.985146 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-44e8a82b-7da2-4420-b5ff-c1cc507916ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:19.987626 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b368-1758-4ad1-9818-98b39a5cc323 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:20.060688 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b368-1758-4ad1-9818-98b39a5cc323 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:20.065850 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4bd8d-5d0c-4690-b1e8-0237d42f4f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:20.066566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4bd8d-5d0c-4690-b1e8-0237d42f4f2e admin admin] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:20.066989 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4bd8d-5d0c-4690-b1e8-0237d42f4f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:20.067454 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4bd8d-5d0c-4690-b1e8-0237d42f4f2e admin admin] PATH_INFO: `/v3/users` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:20.068224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4bd8d-5d0c-4690-b1e8-0237d42f4f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:20.070177 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4bd8d-5d0c-4690-b1e8-0237d42f4f2e admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:20.070340 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 597/1179] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:35:19 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:20.071717 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8a82b-7da2-4420-b5ff-c1cc507916ed None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:20.097611 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8a82b-7da2-4420-b5ff-c1cc507916ed None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:20.102615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 583/1180] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:35:19 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:35:20.103769 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4bd8d-5d0c-4690-b1e8-0237d42f4f2e admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:20.104159 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1f7cc-6f31-47f7-983e-e78f4d57cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:20.104867 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1f7cc-6f31-47f7-983e-e78f4d57cb3b admin admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:20.105217 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1f7cc-6f31-47f7-983e-e78f4d57cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:20.105560 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1f7cc-6f31-47f7-983e-e78f4d57cb3b admin admin] PATH_INFO: `/v3/projects` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:20.106370 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1f7cc-6f31-47f7-983e-e78f4d57cb3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:20.108986 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1f7cc-6f31-47f7-983e-e78f4d57cb3b admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:20.112742 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:20.117386 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4bd8d-5d0c-4690-b1e8-0237d42f4f2e admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:20.135835 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:20.139467 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41272823-3539-42fc-8339-055eb7e80f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:20.140397 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272823-3539-42fc-8339-055eb7e80f81 admin admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:20.140900 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272823-3539-42fc-8339-055eb7e80f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:20.141431 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272823-3539-42fc-8339-055eb7e80f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:20.142268 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41272823-3539-42fc-8339-055eb7e80f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:20.144137 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41272823-3539-42fc-8339-055eb7e80f81 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:20.155845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 598/1181] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Aug 19 19:35:20 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:35:20.156812 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1f7cc-6f31-47f7-983e-e78f4d57cb3b admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:20.160772 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 584/1182] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 19:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:35:20.161743 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41272823-3539-42fc-8339-055eb7e80f81 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:20.173416 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41272823-3539-42fc-8339-055eb7e80f81 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:20.247195 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1f7cc-6f31-47f7-983e-e78f4d57cb3b admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:20.256154 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2764a6-f424-4d3a-8f0b-6cd448d47639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:20.257132 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2764a6-f424-4d3a-8f0b-6cd448d47639 admin admin] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:20.257404 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2764a6-f424-4d3a-8f0b-6cd448d47639 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:20.257598 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd512f9-4634-4bc0-9917-89d046fa6473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:20.257716 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2764a6-f424-4d3a-8f0b-6cd448d47639 admin admin] PATH_INFO: `/v3/users` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:20.258554 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2764a6-f424-4d3a-8f0b-6cd448d47639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:20.260169 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd512f9-4634-4bc0-9917-89d046fa6473 admin admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:20.260447 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd512f9-4634-4bc0-9917-89d046fa6473 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:20.260869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2764a6-f424-4d3a-8f0b-6cd448d47639 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:20.261162 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd512f9-4634-4bc0-9917-89d046fa6473 admin admin] PATH_INFO: `/v3/projects/0b0be1f89866493d8f7b7f6719c2e761/users/83bb7f167f934240a2530ce096bf0b26/roles/4ef4b944934e44a28a394ebd1a816f64` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:20.285061 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd512f9-4634-4bc0-9917-89d046fa6473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0be1f89866493d8f7b7f6719c2e761, user_id=83bb7f167f934240a2530ce096bf0b26, role_id=4ef4b944934e44a28a394ebd1a816f64)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:20.288579 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd512f9-4634-4bc0-9917-89d046fa6473 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:20.291273 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 599/1183] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 19:35:20 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:35:20.295649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2764a6-f424-4d3a-8f0b-6cd448d47639 admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:20.309014 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2764a6-f424-4d3a-8f0b-6cd448d47639 admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:20.311980 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 585/1184] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 19:35:20 2022] PUT /identity/v3/projects/0b0be1f89866493d8f7b7f6719c2e761/users/83bb7f167f934240a2530ce096bf0b26/roles/4ef4b944934e44a28a394ebd1a816f64 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:35:20.313224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd512f9-4634-4bc0-9917-89d046fa6473 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:20.421107 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74322a5-bbe5-41f4-9de0-6226cad7c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:20.421863 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74322a5-bbe5-41f4-9de0-6226cad7c629 admin admin] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:20.422399 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74322a5-bbe5-41f4-9de0-6226cad7c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:20.423215 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74322a5-bbe5-41f4-9de0-6226cad7c629 admin admin] PATH_INFO: `/v3/roles` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:20.424013 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74322a5-bbe5-41f4-9de0-6226cad7c629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:20.426435 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74322a5-bbe5-41f4-9de0-6226cad7c629 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:20.432900 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd512f9-4634-4bc0-9917-89d046fa6473 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:20.438827 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 600/1185] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 19:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:35:20.439577 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253bc4a-388c-4074-9e56-ccdf8cb05f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:20.440196 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253bc4a-388c-4074-9e56-ccdf8cb05f16 admin admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:20.440476 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253bc4a-388c-4074-9e56-ccdf8cb05f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:20.440744 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253bc4a-388c-4074-9e56-ccdf8cb05f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:20.441633 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253bc4a-388c-4074-9e56-ccdf8cb05f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:20.443631 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74322a5-bbe5-41f4-9de0-6226cad7c629 admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:20.447101 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253bc4a-388c-4074-9e56-ccdf8cb05f16 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:20.461746 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 586/1186] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 19:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:35:20.466692 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253bc4a-388c-4074-9e56-ccdf8cb05f16 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:20.474120 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74322a5-bbe5-41f4-9de0-6226cad7c629 admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:20.478226 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253bc4a-388c-4074-9e56-ccdf8cb05f16 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:20.483338 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d5143-d360-4049-8f77-0fb44db3a7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:20.484101 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d5143-d360-4049-8f77-0fb44db3a7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:20.484442 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d5143-d360-4049-8f77-0fb44db3a7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:20.484826 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d5143-d360-4049-8f77-0fb44db3a7d6 admin admin] PATH_INFO: `/v3/projects/0b0be1f89866493d8f7b7f6719c2e761/users/83bb7f167f934240a2530ce096bf0b26/roles/4ef4b944934e44a28a394ebd1a816f64` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:20.487304 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d5143-d360-4049-8f77-0fb44db3a7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0be1f89866493d8f7b7f6719c2e761, user_id=83bb7f167f934240a2530ce096bf0b26, role_id=4ef4b944934e44a28a394ebd1a816f64)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:20.489974 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7f37b-1767-4081-b3c0-3ff2cd489815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:20.490656 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d5143-d360-4049-8f77-0fb44db3a7d6 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:20.490869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7f37b-1767-4081-b3c0-3ff2cd489815 admin admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:20.491147 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7f37b-1767-4081-b3c0-3ff2cd489815 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:20.491416 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7f37b-1767-4081-b3c0-3ff2cd489815 admin admin] PATH_INFO: `/v3/projects/03f90de563fb4b4980728b86b6fedced/users/85d6ff8c641f4ed58a2edf0f029e547b/roles/4ef4b944934e44a28a394ebd1a816f64` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:20.506201 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 587/1187] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 19:35:20 2022] PUT /identity/v3/projects/0b0be1f89866493d8f7b7f6719c2e761/users/83bb7f167f934240a2530ce096bf0b26/roles/4ef4b944934e44a28a394ebd1a816f64 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:35:20.515021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7f37b-1767-4081-b3c0-3ff2cd489815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f90de563fb4b4980728b86b6fedced, user_id=85d6ff8c641f4ed58a2edf0f029e547b, role_id=4ef4b944934e44a28a394ebd1a816f64)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:20.517246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7f37b-1767-4081-b3c0-3ff2cd489815 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:20.535849 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 601/1188] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 19:35:20 2022] PUT /identity/v3/projects/03f90de563fb4b4980728b86b6fedced/users/85d6ff8c641f4ed58a2edf0f029e547b/roles/4ef4b944934e44a28a394ebd1a816f64 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:35:20.540010 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d5143-d360-4049-8f77-0fb44db3a7d6 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:20.620607 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d5143-d360-4049-8f77-0fb44db3a7d6 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:20.626413 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:20.696028 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d5772-f9b3-444e-b217-64fbe105c10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:20.696699 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d5772-f9b3-444e-b217-64fbe105c10f admin admin] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:20.696977 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d5772-f9b3-444e-b217-64fbe105c10f admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:20.697248 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d5772-f9b3-444e-b217-64fbe105c10f admin admin] PATH_INFO: `/v3/roles` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:20.697893 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d5772-f9b3-444e-b217-64fbe105c10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:20.699653 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d5772-f9b3-444e-b217-64fbe105c10f admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:20.718781 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 588/1189] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 19:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:35:20.719666 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7f37b-1767-4081-b3c0-3ff2cd489815 admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:20.733073 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7f37b-1767-4081-b3c0-3ff2cd489815 admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:20.738706 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1d4e6-7913-4e38-8ca8-fa0540af231b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:20.739833 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d4e6-7913-4e38-8ca8-fa0540af231b admin admin] REQUEST_METHOD: `PUT` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:20.740367 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d4e6-7913-4e38-8ca8-fa0540af231b admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:20.740880 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d4e6-7913-4e38-8ca8-fa0540af231b admin admin] PATH_INFO: `/v3/projects/03f90de563fb4b4980728b86b6fedced/users/85d6ff8c641f4ed58a2edf0f029e547b/roles/4ef4b944934e44a28a394ebd1a816f64` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:20.743249 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1d4e6-7913-4e38-8ca8-fa0540af231b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f90de563fb4b4980728b86b6fedced, user_id=85d6ff8c641f4ed58a2edf0f029e547b, role_id=4ef4b944934e44a28a394ebd1a816f64)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:20.747313 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1d4e6-7913-4e38-8ca8-fa0540af231b admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:20.765545 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 602/1190] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 19:35:20 2022] PUT /identity/v3/projects/03f90de563fb4b4980728b86b6fedced/users/85d6ff8c641f4ed58a2edf0f029e547b/roles/4ef4b944934e44a28a394ebd1a816f64 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:35:26.425067 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5264b-dbdd-4eb8-b288-2a373f4a7f02 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:26.425742 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5264b-dbdd-4eb8-b288-2a373f4a7f02 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:26.425742 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5264b-dbdd-4eb8-b288-2a373f4a7f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:26.460030 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-b8c5264b-dbdd-4eb8-b288-2a373f4a7f02 None None] MFA Rules not processed for user `83bb7f167f934240a2530ce096bf0b26`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:26.461613 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-b8c5264b-dbdd-4eb8-b288-2a373f4a7f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:26.589852 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 589/1191] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:35:26 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:26.599938 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1d4e6-7913-4e38-8ca8-fa0540af231b admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:26.601669 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-b6f1d4e6-7913-4e38-8ca8-fa0540af231b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:26.701367 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cec10-a41b-450e-8c56-fd226768bcd5 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:26.702029 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cec10-a41b-450e-8c56-fd226768bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:26.702766 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cec10-a41b-450e-8c56-fd226768bcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:26.736724 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:26.768774 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-3a0cec10-a41b-450e-8c56-fd226768bcd5 None None] MFA Rules not processed for user `85d6ff8c641f4ed58a2edf0f029e547b`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:26.773618 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-3a0cec10-a41b-450e-8c56-fd226768bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:26.783125 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1d4e6-7913-4e38-8ca8-fa0540af231b admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:26.796186 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e9a89-b134-4d86-8f45-8a7a47a7216a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f36f349d532411ba09da3231aef3f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:26.797110 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9a89-b134-4d86-8f45-8a7a47a7216a service glance] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:26.797626 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9a89-b134-4d86-8f45-8a7a47a7216a service glance] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:26.798842 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9a89-b134-4d86-8f45-8a7a47a7216a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:26.922717 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e9a89-b134-4d86-8f45-8a7a47a7216a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:26.924583 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e9a89-b134-4d86-8f45-8a7a47a7216a service glance] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:26.932948 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 590/1192] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:35:26 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:35:26.942863 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 603/1193] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:26 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:35:26.956589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cec10-a41b-450e-8c56-fd226768bcd5 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:26.959383 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-3a0cec10-a41b-450e-8c56-fd226768bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:26.974108 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cec10-a41b-450e-8c56-fd226768bcd5 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:26.978910 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29503f-7b40-409f-b5dd-4eae68d82c88 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f36f349d532411ba09da3231aef3f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:26.979631 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29503f-7b40-409f-b5dd-4eae68d82c88 service glance] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:26.980009 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29503f-7b40-409f-b5dd-4eae68d82c88 service glance] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:26.980374 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29503f-7b40-409f-b5dd-4eae68d82c88 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:26.992741 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=100 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:27.141685 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29503f-7b40-409f-b5dd-4eae68d82c88 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:27.145128 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29503f-7b40-409f-b5dd-4eae68d82c88 service glance] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:27.161921 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 591/1194] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:26 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:35:35.843905 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c59c88-dab8-4ddf-9bea-449b1b375a5b None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:35.844673 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c59c88-dab8-4ddf-9bea-449b1b375a5b None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:35.845021 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c59c88-dab8-4ddf-9bea-449b1b375a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:35.877049 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-c8c59c88-dab8-4ddf-9bea-449b1b375a5b None None] MFA Rules not processed for user `8c01b24b3a214f61acc32686e9ec03d1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:35.878810 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-c8c59c88-dab8-4ddf-9bea-449b1b375a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:35.891558 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 604/1195] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:35:35 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:36.186983 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85a18-75cf-4e5d-80e2-33ef2d89509a None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:36.187589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85a18-75cf-4e5d-80e2-33ef2d89509a None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:36.187589 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85a18-75cf-4e5d-80e2-33ef2d89509a None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:36.189218 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 592/1196] 10.222.0.60 () {54 vars in 962 bytes} [Fri Aug 19 19:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:35:36.201110 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185f62-779e-4470-9769-f938086d31bb None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:36.201638 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185f62-779e-4470-9769-f938086d31bb None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:36.202145 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185f62-779e-4470-9769-f938086d31bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:36.252556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-7c185f62-779e-4470-9769-f938086d31bb None None] MFA Rules not processed for user `ff0c7740e6814c6c9515d0aed78bba68`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:36.254231 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-7c185f62-779e-4470-9769-f938086d31bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:36.324539 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 605/1197] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Aug 19 19:35:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:36.330896 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be421e-6142-4596-b34d-89c324c9bbae None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:36.331179 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be421e-6142-4596-b34d-89c324c9bbae None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:36.331603 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be421e-6142-4596-b34d-89c324c9bbae None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:36.333726 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 593/1198] 10.222.0.60 () {54 vars in 912 bytes} [Fri Aug 19 19:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:35:36.339333 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf71df-018a-44de-b964-8d57c1aea813 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:36.339627 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf71df-018a-44de-b964-8d57c1aea813 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:36.340084 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf71df-018a-44de-b964-8d57c1aea813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:36.361836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-e9bf71df-018a-44de-b964-8d57c1aea813 None None] MFA Rules not processed for user `ff0c7740e6814c6c9515d0aed78bba68`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:36.363514 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-e9bf71df-018a-44de-b964-8d57c1aea813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:36.374877 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 606/1199] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Aug 19 19:35:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:36.387446 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be421e-6142-4596-b34d-89c324c9bbae None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:36.401486 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be421e-6142-4596-b34d-89c324c9bbae None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:36.406139 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03724e-e4db-4fd6-8848-f1a85d5826ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f36f349d532411ba09da3231aef3f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:36.407016 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03724e-e4db-4fd6-8848-f1a85d5826ba service glance] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:36.407472 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03724e-e4db-4fd6-8848-f1a85d5826ba service glance] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:36.407952 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03724e-e4db-4fd6-8848-f1a85d5826ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:36.419256 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03724e-e4db-4fd6-8848-f1a85d5826ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:36.420726 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03724e-e4db-4fd6-8848-f1a85d5826ba service glance] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:36.432719 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 594/1200] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:36 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:35:36.993800 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b50a12-42c8-42c5-8054-e645cb5c81cb None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:36.994419 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b50a12-42c8-42c5-8054-e645cb5c81cb None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:36.994419 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b50a12-42c8-42c5-8054-e645cb5c81cb None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:36.995736 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 607/1201] 10.222.0.60 () {54 vars in 912 bytes} [Fri Aug 19 19:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:35:37.001143 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c3159-8c87-4dff-a676-faf05f5353f4 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:37.001476 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c3159-8c87-4dff-a676-faf05f5353f4 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:37.001756 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c3159-8c87-4dff-a676-faf05f5353f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:37.035632 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-e28c3159-8c87-4dff-a676-faf05f5353f4 None None] MFA Rules not processed for user `3ba4a0ad60a549bd8255124ffcd83f30`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:37.036846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-e28c3159-8c87-4dff-a676-faf05f5353f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:37.090524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 595/1202] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Aug 19 19:35:36 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:37.102035 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b50a12-42c8-42c5-8054-e645cb5c81cb None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:37.105691 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-c9b50a12-42c8-42c5-8054-e645cb5c81cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:37.119405 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b50a12-42c8-42c5-8054-e645cb5c81cb None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:37.123436 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf838-2629-45ad-934e-006f4844e942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:37.124127 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf838-2629-45ad-934e-006f4844e942 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:37.124488 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf838-2629-45ad-934e-006f4844e942 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:37.124839 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf838-2629-45ad-934e-006f4844e942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:37.132776 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edf838-2629-45ad-934e-006f4844e942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:37.134286 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edf838-2629-45ad-934e-006f4844e942 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:37.142709 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 608/1203] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:37 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:35:37.545809 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c9899-2daf-458c-9552-433338d43ffb None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:37.546578 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c9899-2daf-458c-9552-433338d43ffb None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:37.546578 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c9899-2daf-458c-9552-433338d43ffb None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:37.547794 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 596/1204] 10.222.0.60 () {54 vars in 962 bytes} [Fri Aug 19 19:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:35:37.555963 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebd21f-53a8-414f-aac7-07db58cf141e None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:37.556254 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebd21f-53a8-414f-aac7-07db58cf141e None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:37.556521 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebd21f-53a8-414f-aac7-07db58cf141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:37.576674 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-98ebd21f-53a8-414f-aac7-07db58cf141e None None] MFA Rules not processed for user `ff0c7740e6814c6c9515d0aed78bba68`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:37.577895 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-98ebd21f-53a8-414f-aac7-07db58cf141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:37.579031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c9899-2daf-458c-9552-433338d43ffb None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:37.587538 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 609/1205] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Aug 19 19:35:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:37.594242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb1018-4316-4662-a8dd-f01b1d5f7839 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:37.594599 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb1018-4316-4662-a8dd-f01b1d5f7839 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:37.594945 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb1018-4316-4662-a8dd-f01b1d5f7839 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:37.596494 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 610/1206] 10.222.0.60 () {54 vars in 912 bytes} [Fri Aug 19 19:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:35:37.602503 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7132b0-5926-4fc9-a2f2-9d7531d995ff None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:37.602854 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7132b0-5926-4fc9-a2f2-9d7531d995ff None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:37.603185 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7132b0-5926-4fc9-a2f2-9d7531d995ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:37.630252 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-6d7132b0-5926-4fc9-a2f2-9d7531d995ff None None] MFA Rules not processed for user `ff0c7740e6814c6c9515d0aed78bba68`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:37.631740 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-6d7132b0-5926-4fc9-a2f2-9d7531d995ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:37.641810 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 611/1207] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Aug 19 19:35:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:35:37.654724 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7132b0-5926-4fc9-a2f2-9d7531d995ff None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:37.665844 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7132b0-5926-4fc9-a2f2-9d7531d995ff None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:37.670260 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d245a07-e233-4ff3-be55-5f48ba027adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:37.671174 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d245a07-e233-4ff3-be55-5f48ba027adb service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:37.671609 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d245a07-e233-4ff3-be55-5f48ba027adb service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:37.671883 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d245a07-e233-4ff3-be55-5f48ba027adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:37.683539 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d245a07-e233-4ff3-be55-5f48ba027adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:37.685320 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d245a07-e233-4ff3-be55-5f48ba027adb service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:37.688811 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c9899-2daf-458c-9552-433338d43ffb None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:37.696127 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7926ac9-21fb-451d-811e-fb29d6d2f118 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35957952c2a142ba868279f19ab4d46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:37.696803 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7926ac9-21fb-451d-811e-fb29d6d2f118 service placement] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:37.697155 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7926ac9-21fb-451d-811e-fb29d6d2f118 service placement] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:37.697435 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7926ac9-21fb-451d-811e-fb29d6d2f118 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:37.699505 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-b7926ac9-21fb-451d-811e-fb29d6d2f118 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:37.702160 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 612/1208] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:37 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:35:37.713215 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7926ac9-21fb-451d-811e-fb29d6d2f118 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:37.715000 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7926ac9-21fb-451d-811e-fb29d6d2f118 service placement] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:37.727680 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 597/1209] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:37 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:35:47.692276 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=91 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:47.723292 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=88 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:47.987950 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c50c-30d8-46b4-891b-76c55d342194 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:47.988270 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c50c-30d8-46b4-891b-76c55d342194 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:47.988542 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c50c-30d8-46b4-891b-76c55d342194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:48.010951 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-1771c50c-30d8-46b4-891b-76c55d342194 None None] MFA Rules not processed for user `3ba4a0ad60a549bd8255124ffcd83f30`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:48.012191 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-1771c50c-30d8-46b4-891b-76c55d342194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:48.019821 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 613/1210] 10.222.0.43 () {58 vars in 1015 bytes} [Fri Aug 19 19:35:47 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:48.032591 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7926ac9-21fb-451d-811e-fb29d6d2f118 service placement] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:48.042843 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7926ac9-21fb-451d-811e-fb29d6d2f118 service placement] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:48.047137 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a488ee-1ae8-4e4b-b058-25d56a1cd4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:48.047722 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a488ee-1ae8-4e4b-b058-25d56a1cd4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:48.048003 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a488ee-1ae8-4e4b-b058-25d56a1cd4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:48.048441 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a488ee-1ae8-4e4b-b058-25d56a1cd4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:48.056225 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a488ee-1ae8-4e4b-b058-25d56a1cd4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:48.057668 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a488ee-1ae8-4e4b-b058-25d56a1cd4c4 service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:48.066036 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 598/1211] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:48 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:35:48.989672 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828926-33a7-46ab-a89f-a83b7c8b278c None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:48.990310 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828926-33a7-46ab-a89f-a83b7c8b278c None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:48.990310 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828926-33a7-46ab-a89f-a83b7c8b278c None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:48.991757 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 614/1212] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 19:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:35:49.009708 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99e66-a5e4-4619-bf56-4e2db9391141 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:49.010291 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99e66-a5e4-4619-bf56-4e2db9391141 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:49.011139 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99e66-a5e4-4619-bf56-4e2db9391141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:49.035099 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-4ce99e66-a5e4-4619-bf56-4e2db9391141 None None] MFA Rules not processed for user `ff0c7740e6814c6c9515d0aed78bba68`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:49.036330 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-4ce99e66-a5e4-4619-bf56-4e2db9391141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:49.046397 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 599/1213] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 19:35:49 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:49.077298 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828926-33a7-46ab-a89f-a83b7c8b278c None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:49.092784 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828926-33a7-46ab-a89f-a83b7c8b278c None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:49.098665 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac611b0-7a01-4fea-9a4c-1b0920fe1e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:49.099331 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac611b0-7a01-4fea-9a4c-1b0920fe1e09 service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:49.099615 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac611b0-7a01-4fea-9a4c-1b0920fe1e09 service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:49.099876 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac611b0-7a01-4fea-9a4c-1b0920fe1e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:49.109593 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac611b0-7a01-4fea-9a4c-1b0920fe1e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:49.111237 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac611b0-7a01-4fea-9a4c-1b0920fe1e09 service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:49.121374 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 615/1214] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:49 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:35:54.802363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34475-be94-4585-ba29-644d691ce341 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:54.802363 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34475-be94-4585-ba29-644d691ce341 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:54.803103 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34475-be94-4585-ba29-644d691ce341 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:54.803805 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 600/1215] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 19:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:35:54.813190 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3dbec-ad3f-4113-9c55-546b7401586a None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:54.813784 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3dbec-ad3f-4113-9c55-546b7401586a None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:54.813784 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3dbec-ad3f-4113-9c55-546b7401586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:54.841502 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-4cb3dbec-ad3f-4113-9c55-546b7401586a None None] MFA Rules not processed for user `ff0c7740e6814c6c9515d0aed78bba68`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:54.842982 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-4cb3dbec-ad3f-4113-9c55-546b7401586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:54.852511 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 616/1216] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 19:35:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:54.883458 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34475-be94-4585-ba29-644d691ce341 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:54.899524 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34475-be94-4585-ba29-644d691ce341 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:54.913181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e446e-c877-4c10-b7bb-e0372fcfc525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:54.913792 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e446e-c877-4c10-b7bb-e0372fcfc525 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:54.914532 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e446e-c877-4c10-b7bb-e0372fcfc525 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:54.914810 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e446e-c877-4c10-b7bb-e0372fcfc525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:54.924119 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e446e-c877-4c10-b7bb-e0372fcfc525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:54.925695 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e446e-c877-4c10-b7bb-e0372fcfc525 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:54.937175 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 601/1217] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:54 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:36:04.835675 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=12 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:36:04.937554 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=15 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:36:07.846323 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3dbec-ad3f-4113-9c55-546b7401586a None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:36:07.856845 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3dbec-ad3f-4113-9c55-546b7401586a None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:36:07.860413 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a381f0-1d1b-4ed0-b50d-0e001df1d16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:36:07.861025 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a381f0-1d1b-4ed0-b50d-0e001df1d16b service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:36:07.861267 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a381f0-1d1b-4ed0-b50d-0e001df1d16b service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:36:07.861535 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a381f0-1d1b-4ed0-b50d-0e001df1d16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:36:07.873483 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a381f0-1d1b-4ed0-b50d-0e001df1d16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:36:07.875606 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a381f0-1d1b-4ed0-b50d-0e001df1d16b service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:36:07.887577 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 617/1218] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:36:07 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:36:17.882447 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=6 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:36:26.954320 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d078b0-ac97-4826-84b5-903cacc6492e None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:36:26.954900 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d078b0-ac97-4826-84b5-903cacc6492e None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:36:26.954900 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d078b0-ac97-4826-84b5-903cacc6492e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:36:26.976204 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-a8d078b0-ac97-4826-84b5-903cacc6492e None None] MFA Rules not processed for user `5f507c90e1b04bb9a3a7bf9ef3802c38`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:36:26.977456 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-a8d078b0-ac97-4826-84b5-903cacc6492e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:36:26.988220 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 602/1219] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:36:26 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:36:36.971138 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=3 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:36:53.642332 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9a96-7b5c-4796-97d3-41e541b2f90d None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:36:53.642895 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9a96-7b5c-4796-97d3-41e541b2f90d None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:36:53.642895 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9a96-7b5c-4796-97d3-41e541b2f90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:36:53.668836 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-ccee9a96-7b5c-4796-97d3-41e541b2f90d None None] MFA Rules not processed for user `5f507c90e1b04bb9a3a7bf9ef3802c38`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:36:53.670086 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-ccee9a96-7b5c-4796-97d3-41e541b2f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:36:53.677422 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 618/1220] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:36:53 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:36:53.986719 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e53d0-5947-49f6-8494-4d0872d282a5 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:36:53.987207 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e53d0-5947-49f6-8494-4d0872d282a5 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:36:53.987392 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e53d0-5947-49f6-8494-4d0872d282a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:36:54.007924 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-5d5e53d0-5947-49f6-8494-4d0872d282a5 None None] MFA Rules not processed for user `3ba4a0ad60a549bd8255124ffcd83f30`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:36:54.009122 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-5d5e53d0-5947-49f6-8494-4d0872d282a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:36:54.017234 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 603/1221] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Aug 19 19:36:53 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:36:54.029243 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee9a96-7b5c-4796-97d3-41e541b2f90d None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:36:54.039757 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee9a96-7b5c-4796-97d3-41e541b2f90d None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:36:54.043814 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc1886-3fa4-4c55-ae8b-3cbd80b88387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:36:54.044413 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc1886-3fa4-4c55-ae8b-3cbd80b88387 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:36:54.044687 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc1886-3fa4-4c55-ae8b-3cbd80b88387 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:36:54.044949 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc1886-3fa4-4c55-ae8b-3cbd80b88387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:36:54.052233 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc1886-3fa4-4c55-ae8b-3cbd80b88387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:36:54.053711 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc1886-3fa4-4c55-ae8b-3cbd80b88387 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:36:54.061441 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 619/1222] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:36:54 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:37:04.002712 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=3 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:37:04.058501 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=9 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:37:07.707513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64748484-411b-4f0d-ab2f-d6a0d529b6e6 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:37:07.708035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64748484-411b-4f0d-ab2f-d6a0d529b6e6 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:37:07.708035 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64748484-411b-4f0d-ab2f-d6a0d529b6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:37:07.728461 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-64748484-411b-4f0d-ab2f-d6a0d529b6e6 None None] MFA Rules not processed for user `5f507c90e1b04bb9a3a7bf9ef3802c38`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:37:07.729674 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-64748484-411b-4f0d-ab2f-d6a0d529b6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:37:07.738683 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 604/1223] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:37:07 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:37:17.723171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=3 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:38:06.918324 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee092d-2f80-45ae-a864-b7ca8a50e932 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:06.919150 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee092d-2f80-45ae-a864-b7ca8a50e932 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:06.919278 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee092d-2f80-45ae-a864-b7ca8a50e932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:06.948191 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-b9ee092d-2f80-45ae-a864-b7ca8a50e932 None None] MFA Rules not processed for user `5f507c90e1b04bb9a3a7bf9ef3802c38`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:38:06.949490 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-b9ee092d-2f80-45ae-a864-b7ca8a50e932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:38:06.958089 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 620/1224] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:38:06 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:38:16.943589 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=3 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:38:20.099491 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64748484-411b-4f0d-ab2f-d6a0d529b6e6 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:38:20.121231 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64748484-411b-4f0d-ab2f-d6a0d529b6e6 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:38:20.125070 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49204ac1-5639-469b-a6a9-3cddabcef8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:38:20.125669 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204ac1-5639-469b-a6a9-3cddabcef8fc service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:20.125937 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204ac1-5639-469b-a6a9-3cddabcef8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:20.126236 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204ac1-5639-469b-a6a9-3cddabcef8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:20.136325 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49204ac1-5639-469b-a6a9-3cddabcef8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:38:20.137754 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49204ac1-5639-469b-a6a9-3cddabcef8fc service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:38:20.148780 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 605/1225] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:38:20 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:38:22.284258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57afef6-3c48-4da9-9986-e9ab3094b174 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:22.284819 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57afef6-3c48-4da9-9986-e9ab3094b174 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:22.284819 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57afef6-3c48-4da9-9986-e9ab3094b174 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:22.286242 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 621/1226] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 19:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:38:22.291314 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e646b-203a-49e1-8dc7-891c5b42c1e9 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:22.291775 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e646b-203a-49e1-8dc7-891c5b42c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:22.291875 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e646b-203a-49e1-8dc7-891c5b42c1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:22.323291 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-a19e646b-203a-49e1-8dc7-891c5b42c1e9 None None] MFA Rules not processed for user `ff0c7740e6814c6c9515d0aed78bba68`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:38:22.324508 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-a19e646b-203a-49e1-8dc7-891c5b42c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:38:22.334342 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 606/1227] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 19:38:22 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:38:22.348226 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57afef6-3c48-4da9-9986-e9ab3094b174 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:38:22.362681 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57afef6-3c48-4da9-9986-e9ab3094b174 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:38:22.368179 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ff7f2-0f44-49e0-bb13-3a87f1f0104d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:38:22.368820 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ff7f2-0f44-49e0-bb13-3a87f1f0104d service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:22.369093 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ff7f2-0f44-49e0-bb13-3a87f1f0104d service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:22.369359 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ff7f2-0f44-49e0-bb13-3a87f1f0104d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:22.377792 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ff7f2-0f44-49e0-bb13-3a87f1f0104d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:38:22.379430 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ff7f2-0f44-49e0-bb13-3a87f1f0104d service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:38:22.389515 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 622/1228] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:38:22 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:38:32.318273 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=17 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:38:32.385474 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=6 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:39:42.650227 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e646b-203a-49e1-8dc7-891c5b42c1e9 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:39:42.677425 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e646b-203a-49e1-8dc7-891c5b42c1e9 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:39:42.683696 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b2e85-9f57-445e-a132-09bd9458c16a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35957952c2a142ba868279f19ab4d46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:39:42.684297 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b2e85-9f57-445e-a132-09bd9458c16a service placement] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:39:42.684560 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b2e85-9f57-445e-a132-09bd9458c16a service placement] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:39:42.684823 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b2e85-9f57-445e-a132-09bd9458c16a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:39:42.694374 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b2e85-9f57-445e-a132-09bd9458c16a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:39:42.695982 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b2e85-9f57-445e-a132-09bd9458c16a service placement] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:39:42.705861 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 607/1229] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:39:42 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:39:52.701656 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=10 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:40:00.049233 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e8536-e472-4c4e-9e0a-1267e9ad77f7 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:00.049748 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e8536-e472-4c4e-9e0a-1267e9ad77f7 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:00.049748 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e8536-e472-4c4e-9e0a-1267e9ad77f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:00.079046 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-1e4e8536-e472-4c4e-9e0a-1267e9ad77f7 None None] MFA Rules not processed for user `8c01b24b3a214f61acc32686e9ec03d1`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:40:00.080582 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-1e4e8536-e472-4c4e-9e0a-1267e9ad77f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:40:00.089057 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 623/1230] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:40:00 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:40:10.071100 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=3 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:40:25.475411 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b2e85-9f57-445e-a132-09bd9458c16a service placement] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:40:25.496707 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b2e85-9f57-445e-a132-09bd9458c16a service placement] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:40:25.502471 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327450bd-0a72-45f7-8364-864e5ee93074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:40:25.503059 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327450bd-0a72-45f7-8364-864e5ee93074 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:25.503335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327450bd-0a72-45f7-8364-864e5ee93074 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:25.503586 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327450bd-0a72-45f7-8364-864e5ee93074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:25.511759 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327450bd-0a72-45f7-8364-864e5ee93074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:40:25.513359 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327450bd-0a72-45f7-8364-864e5ee93074 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:40:25.522875 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 608/1231] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:40:25 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:40:35.518513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=10 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:40:35.918649 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e8536-e472-4c4e-9e0a-1267e9ad77f7 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:40:35.931734 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e8536-e472-4c4e-9e0a-1267e9ad77f7 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:40:35.938141 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903e0c-bb78-44e6-b670-d7f96c803940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:40:35.938750 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903e0c-bb78-44e6-b670-d7f96c803940 service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:35.939022 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903e0c-bb78-44e6-b670-d7f96c803940 service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:35.939286 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903e0c-bb78-44e6-b670-d7f96c803940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:35.947497 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79903e0c-bb78-44e6-b670-d7f96c803940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:40:35.949091 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79903e0c-bb78-44e6-b670-d7f96c803940 service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:40:35.958558 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 624/1232] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:40:35 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:40:37.351154 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327450bd-0a72-45f7-8364-864e5ee93074 service nova] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:40:37.363498 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327450bd-0a72-45f7-8364-864e5ee93074 service nova] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:40:37.371596 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f4e16-3e41-4408-a846-8dbc8aabe444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:40:37.372426 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4e16-3e41-4408-a846-8dbc8aabe444 service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:37.372795 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4e16-3e41-4408-a846-8dbc8aabe444 service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:37.373127 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4e16-3e41-4408-a846-8dbc8aabe444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:37.384425 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f4e16-3e41-4408-a846-8dbc8aabe444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:40:37.385853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f4e16-3e41-4408-a846-8dbc8aabe444 service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:40:37.396892 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 609/1233] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:40:37 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:40:38.594323 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903e0c-bb78-44e6-b670-d7f96c803940 service nova] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:40:38.604838 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903e0c-bb78-44e6-b670-d7f96c803940 service nova] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:40:38.609137 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bdfcf-db90-42c2-9b1a-59d62e490609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:40:38.609872 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bdfcf-db90-42c2-9b1a-59d62e490609 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:38.610377 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bdfcf-db90-42c2-9b1a-59d62e490609 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:38.610782 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bdfcf-db90-42c2-9b1a-59d62e490609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:38.622616 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bdfcf-db90-42c2-9b1a-59d62e490609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:40:38.624073 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bdfcf-db90-42c2-9b1a-59d62e490609 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:40:38.637118 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 625/1234] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:40:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:40:39.775803 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e5b7-fc98-4ce8-b7db-683657332214 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:39.776352 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e5b7-fc98-4ce8-b7db-683657332214 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:39.776352 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e5b7-fc98-4ce8-b7db-683657332214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:39.796900 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-b850e5b7-fc98-4ce8-b7db-683657332214 None None] MFA Rules not processed for user `5f507c90e1b04bb9a3a7bf9ef3802c38`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:40:39.798122 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-b850e5b7-fc98-4ce8-b7db-683657332214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:40:39.806429 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 610/1235] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:40:39 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:40:40.141929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bdfcf-db90-42c2-9b1a-59d62e490609 service neutron] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:40:40.151284 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bdfcf-db90-42c2-9b1a-59d62e490609 service neutron] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:40:40.155299 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cefad-8858-4bcb-ade2-ba0b29be9277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:40:40.155946 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cefad-8858-4bcb-ade2-ba0b29be9277 service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:40.156221 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cefad-8858-4bcb-ade2-ba0b29be9277 service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:40.156488 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cefad-8858-4bcb-ade2-ba0b29be9277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:40.164180 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cefad-8858-4bcb-ade2-ba0b29be9277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:40:40.165615 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cefad-8858-4bcb-ade2-ba0b29be9277 service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:40:40.173962 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 626/1236] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:40:40 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:40:40.640010 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db74e-f3be-42c1-be97-28214a780441 None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:40.640318 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db74e-f3be-42c1-be97-28214a780441 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:40.640591 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db74e-f3be-42c1-be97-28214a780441 None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:40.642164 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 611/1237] 10.222.0.60 () {54 vars in 961 bytes} [Fri Aug 19 19:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:40:40.648476 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40dfe7-43b1-408a-ab0a-53e2777b8f28 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:40.648970 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40dfe7-43b1-408a-ab0a-53e2777b8f28 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:40.649246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40dfe7-43b1-408a-ab0a-53e2777b8f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:40.705572 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-fe40dfe7-43b1-408a-ab0a-53e2777b8f28 None None] MFA Rules not processed for user `35957952c2a142ba868279f19ab4d46d`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:40:40.706802 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-fe40dfe7-43b1-408a-ab0a-53e2777b8f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:40:40.716509 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 627/1238] 10.222.0.60 () {58 vars in 1058 bytes} [Fri Aug 19 19:40:40 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:40:40.724380 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090db74e-f3be-42c1-be97-28214a780441 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:40:40.738730 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090db74e-f3be-42c1-be97-28214a780441 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:40:40.743747 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343d85f-c167-4072-9f3e-c39c979f69f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35957952c2a142ba868279f19ab4d46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:40:40.744335 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343d85f-c167-4072-9f3e-c39c979f69f8 service placement] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:40.744608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343d85f-c167-4072-9f3e-c39c979f69f8 service placement] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:40.744914 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343d85f-c167-4072-9f3e-c39c979f69f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:40.753171 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343d85f-c167-4072-9f3e-c39c979f69f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:40:40.754784 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343d85f-c167-4072-9f3e-c39c979f69f8 service placement] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:40:40.764178 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 612/1239] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:40:40 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:40:50.703149 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=32 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:40:50.760544 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=15 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:40:51.146173 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40dfe7-43b1-408a-ab0a-53e2777b8f28 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:40:51.156436 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40dfe7-43b1-408a-ab0a-53e2777b8f28 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:40:51.160985 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a7243-ecf7-4a5c-a5ce-5f526ce95dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:40:51.161591 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a7243-ecf7-4a5c-a5ce-5f526ce95dee service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:51.161861 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a7243-ecf7-4a5c-a5ce-5f526ce95dee service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:51.162214 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a7243-ecf7-4a5c-a5ce-5f526ce95dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:51.169650 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a7243-ecf7-4a5c-a5ce-5f526ce95dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:40:51.171132 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a7243-ecf7-4a5c-a5ce-5f526ce95dee service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:40:51.178929 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 628/1240] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:40:51 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:40:56.223892 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343d85f-c167-4072-9f3e-c39c979f69f8 service placement] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:40:56.236770 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343d85f-c167-4072-9f3e-c39c979f69f8 service placement] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:40:56.243114 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efde640-82f4-4a73-8324-c6b50a9c0462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:40:56.243792 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde640-82f4-4a73-8324-c6b50a9c0462 service nova] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:40:56.244072 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde640-82f4-4a73-8324-c6b50a9c0462 service nova] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:40:56.244343 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde640-82f4-4a73-8324-c6b50a9c0462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:40:56.255241 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efde640-82f4-4a73-8324-c6b50a9c0462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:40:56.256851 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efde640-82f4-4a73-8324-c6b50a9c0462 service nova] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:40:56.280055 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 613/1241] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:40:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:41:01.175615 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=6 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:41:06.263463 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=6 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:41:48.809297 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a7243-ecf7-4a5c-a5ce-5f526ce95dee service neutron] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:41:48.819579 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a7243-ecf7-4a5c-a5ce-5f526ce95dee service neutron] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:41:48.823381 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4ed48-8a77-476e-8a30-e4e52f7e403d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:41:48.823975 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ed48-8a77-476e-8a30-e4e52f7e403d service neutron] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:41:48.824246 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ed48-8a77-476e-8a30-e4e52f7e403d service neutron] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:41:48.824513 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ed48-8a77-476e-8a30-e4e52f7e403d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:41:48.887392 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4ed48-8a77-476e-8a30-e4e52f7e403d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:41:48.888840 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4ed48-8a77-476e-8a30-e4e52f7e403d service neutron] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:41:48.908545 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 629/1242] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:41:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:41:52.228557 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7679eb-8a39-4b4c-8b1a-dea1e3afb93b None None] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:41:52.229031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7679eb-8a39-4b4c-8b1a-dea1e3afb93b None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:41:52.229031 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7679eb-8a39-4b4c-8b1a-dea1e3afb93b None None] PATH_INFO: `/` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:41:52.230527 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 614/1243] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 19:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:41:52.242263 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fa964-802a-4756-8308-9fb9f3bf3393 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:41:52.242735 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fa964-802a-4756-8308-9fb9f3bf3393 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:41:52.242837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fa964-802a-4756-8308-9fb9f3bf3393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:41:52.265399 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-077fa964-802a-4756-8308-9fb9f3bf3393 None None] MFA Rules not processed for user `35957952c2a142ba868279f19ab4d46d`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:41:52.266630 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-077fa964-802a-4756-8308-9fb9f3bf3393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:41:52.276023 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 630/1244] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 19:41:52 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:41:52.286959 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7679eb-8a39-4b4c-8b1a-dea1e3afb93b None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:41:52.308224 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7679eb-8a39-4b4c-8b1a-dea1e3afb93b None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:41:52.314384 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621a0b7-70ad-49b4-b15f-c0f39ea3ea4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35957952c2a142ba868279f19ab4d46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:41:52.315123 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a0b7-70ad-49b4-b15f-c0f39ea3ea4d service placement] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:41:52.315631 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a0b7-70ad-49b4-b15f-c0f39ea3ea4d service placement] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:41:52.315967 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a0b7-70ad-49b4-b15f-c0f39ea3ea4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:41:52.327993 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621a0b7-70ad-49b4-b15f-c0f39ea3ea4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:41:52.329656 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621a0b7-70ad-49b4-b15f-c0f39ea3ea4d service placement] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:41:52.345091 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 615/1245] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:41:52 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:41:55.580466 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fa964-802a-4756-8308-9fb9f3bf3393 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:41:55.591789 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fa964-802a-4756-8308-9fb9f3bf3393 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:41:55.596404 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:41:55.597052 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:41:55.597321 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:41:55.597581 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] PATH_INFO: `/v3/users/8c01b24b3a214f61acc32686e9ec03d1` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:41:55.598743 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c01b24b3a214f61acc32686e9ec03d1)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:41:55.600723 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:41:55.661420 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c01b24b3a214f61acc32686e9ec03d1'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:55.673194 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c01b24b3a214f61acc32686e9ec03d1'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:55.673922 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c01b24b3a214f61acc32686e9ec03d1'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:55.674603 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c01b24b3a214f61acc32686e9ec03d1'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:55.682253 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c01b24b3a214f61acc32686e9ec03d1'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:55.697014 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 631/1246] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Aug 19 19:41:55 2022] DELETE /identity/v3/users/8c01b24b3a214f61acc32686e9ec03d1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:41:55.895469 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621a0b7-70ad-49b4-b15f-c0f39ea3ea4d service placement] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:41:55.911800 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621a0b7-70ad-49b4-b15f-c0f39ea3ea4d service placement] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:41:55.971677 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:41:55.972481 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:41:55.972761 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:41:55.973117 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] PATH_INFO: `/v3/projects/42922cbf3a664215b16fc6e5891c8a5a` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:41:55.974285 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42922cbf3a664215b16fc6e5891c8a5a)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:41:55.976287 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:41:56.025542 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42922cbf3a664215b16fc6e5891c8a5a', 'request_id': 'req-45ebb0f1-139e-4a38-8804-9bc8333c2d82'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.032009 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42922cbf3a664215b16fc6e5891c8a5a', 'request_id': 'req-45ebb0f1-139e-4a38-8804-9bc8333c2d82'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.041827 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42922cbf3a664215b16fc6e5891c8a5a', 'request_id': 'req-45ebb0f1-139e-4a38-8804-9bc8333c2d82'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.053556 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] The token cache is being invalidate because project 42922cbf3a664215b16fc6e5891c8a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=123563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 19:41:56.053853 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.054489 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.056181 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 616/1247] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Aug 19 19:41:55 2022] DELETE /identity/v3/projects/42922cbf3a664215b16fc6e5891c8a5a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:41:56.061605 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:41:56.063229 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:41:56.077820 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c294e-5d44-4937-ba2d-ebbe99426e92 admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:41:56.130925 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:41:56.145498 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebb96c-2f36-4cb6-9017-d2317665ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:41:56.146338 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb96c-2f36-4cb6-9017-d2317665ce49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:41:56.146681 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb96c-2f36-4cb6-9017-d2317665ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:41:56.147013 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb96c-2f36-4cb6-9017-d2317665ce49 admin admin] PATH_INFO: `/v3/users/85d6ff8c641f4ed58a2edf0f029e547b` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:41:56.148255 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebb96c-2f36-4cb6-9017-d2317665ce49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d6ff8c641f4ed58a2edf0f029e547b)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:41:56.150240 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebb96c-2f36-4cb6-9017-d2317665ce49 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:41:56.206170 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-ceebb96c-2f36-4cb6-9017-d2317665ce49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d6ff8c641f4ed58a2edf0f029e547b'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.222336 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-ceebb96c-2f36-4cb6-9017-d2317665ce49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d6ff8c641f4ed58a2edf0f029e547b'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.223048 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-ceebb96c-2f36-4cb6-9017-d2317665ce49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d6ff8c641f4ed58a2edf0f029e547b'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.223628 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-ceebb96c-2f36-4cb6-9017-d2317665ce49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d6ff8c641f4ed58a2edf0f029e547b'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.231140 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-ceebb96c-2f36-4cb6-9017-d2317665ce49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d6ff8c641f4ed58a2edf0f029e547b'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.244732 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 632/1248] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Aug 19 19:41:56 2022] DELETE /identity/v3/users/85d6ff8c641f4ed58a2edf0f029e547b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:41:56.433418 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:41:56.434924 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:41:56.448863 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebb0f1-139e-4a38-8804-9bc8333c2d82 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:41:56.513418 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:41:56.514368 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:41:56.514778 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:41:56.515214 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] PATH_INFO: `/v3/projects/03f90de563fb4b4980728b86b6fedced` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:41:56.516611 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f90de563fb4b4980728b86b6fedced)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:41:56.519095 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:41:56.542326 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:41:56.570597 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f90de563fb4b4980728b86b6fedced', 'request_id': 'req-90317641-63ff-4b82-a7d6-9f97402c3002'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.576845 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f90de563fb4b4980728b86b6fedced', 'request_id': 'req-90317641-63ff-4b82-a7d6-9f97402c3002'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.585585 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f90de563fb4b4980728b86b6fedced', 'request_id': 'req-90317641-63ff-4b82-a7d6-9f97402c3002'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.596568 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] The token cache is being invalidate because project 03f90de563fb4b4980728b86b6fedced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=123563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 19:41:56.596849 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.597488 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:41:56.599162 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 617/1249] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Aug 19 19:41:56 2022] DELETE /identity/v3/projects/03f90de563fb4b4980728b86b6fedced => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:42:06.241271 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:42:06.593597 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:42:38.865486 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f509-3422-4065-9ce3-13b4e84dbee8 None None] REQUEST_METHOD: `POST` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:42:38.866068 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f509-3422-4065-9ce3-13b4e84dbee8 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:42:38.866068 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f509-3422-4065-9ce3-13b4e84dbee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:42:38.893569 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.auth.core [None req-1443f509-3422-4065-9ce3-13b4e84dbee8 None None] MFA Rules not processed for user `5f507c90e1b04bb9a3a7bf9ef3802c38`. Rule list: `[]` (Enabled: `True`). {{(pid=123562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:42:38.894825 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-1443f509-3422-4065-9ce3-13b4e84dbee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:42:38.959556 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 633/1250] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 19:42:38 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:42:39.297112 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:42:39.298729 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:42:39.370159 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90317641-63ff-4b82-a7d6-9f97402c3002 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:42:39.374687 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03612cb-1a85-450b-befa-e7aaae80bb2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:42:39.375294 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03612cb-1a85-450b-befa-e7aaae80bb2d service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:42:39.375567 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03612cb-1a85-450b-befa-e7aaae80bb2d service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:42:39.375836 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03612cb-1a85-450b-befa-e7aaae80bb2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:42:39.377737 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-c03612cb-1a85-450b-befa-e7aaae80bb2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:42:39.387822 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03612cb-1a85-450b-befa-e7aaae80bb2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:42:39.389238 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03612cb-1a85-450b-befa-e7aaae80bb2d service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:42:39.397513 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 618/1251] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:42:39 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:42:48.951133 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=25 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:42:49.293635 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443f509-3422-4065-9ce3-13b4e84dbee8 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:42:49.295329 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-1443f509-3422-4065-9ce3-13b4e84dbee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:42:49.383967 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443f509-3422-4065-9ce3-13b4e84dbee8 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:42:49.389014 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7b8cf-d972-42b2-901d-f836115a09ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:42:49.389951 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b8cf-d972-42b2-901d-f836115a09ed service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:42:49.390258 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b8cf-d972-42b2-901d-f836115a09ed service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:42:49.390528 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b8cf-d972-42b2-901d-f836115a09ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:42:49.392639 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-47a7b8cf-d972-42b2-901d-f836115a09ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:42:49.393974 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=26 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:42:49.404986 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7b8cf-d972-42b2-901d-f836115a09ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:42:49.406703 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7b8cf-d972-42b2-901d-f836115a09ed service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:42:49.416545 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 634/1252] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:42:49 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:42:59.412837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=32 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:44:45.542629 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03612cb-1a85-450b-befa-e7aaae80bb2d service neutron] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:44:45.544281 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-c03612cb-1a85-450b-befa-e7aaae80bb2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:44:45.669847 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03612cb-1a85-450b-befa-e7aaae80bb2d service neutron] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:44:45.674965 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37347df-30be-462b-a528-e4a845014f78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35957952c2a142ba868279f19ab4d46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:44:45.675569 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37347df-30be-462b-a528-e4a845014f78 service placement] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:44:45.675846 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37347df-30be-462b-a528-e4a845014f78 service placement] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:44:45.676109 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37347df-30be-462b-a528-e4a845014f78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:44:45.678039 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-d37347df-30be-462b-a528-e4a845014f78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:44:45.689283 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37347df-30be-462b-a528-e4a845014f78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:44:45.690918 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37347df-30be-462b-a528-e4a845014f78 service placement] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:44:45.700711 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 619/1253] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:44:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:44:55.696871 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=54 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:45:19.636888 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7b8cf-d972-42b2-901d-f836115a09ed service nova] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:45:19.639472 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-47a7b8cf-d972-42b2-901d-f836115a09ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:45:19.713236 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7b8cf-d972-42b2-901d-f836115a09ed service nova] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:45:19.718895 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de516f07-f152-4ade-aa81-7bbfe3fd172c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0c7740e6814c6c9515d0aed78bba68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:45:19.719584 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de516f07-f152-4ade-aa81-7bbfe3fd172c service nova] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:45:19.719891 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de516f07-f152-4ade-aa81-7bbfe3fd172c service nova] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:45:19.720114 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de516f07-f152-4ade-aa81-7bbfe3fd172c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:45:19.722085 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-de516f07-f152-4ade-aa81-7bbfe3fd172c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:45:19.736727 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de516f07-f152-4ade-aa81-7bbfe3fd172c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:45:19.739045 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de516f07-f152-4ade-aa81-7bbfe3fd172c service nova] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:45:19.751931 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 635/1254] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:45:19 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:45:26.224911 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37347df-30be-462b-a528-e4a845014f78 service placement] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:45:26.226673 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-d37347df-30be-462b-a528-e4a845014f78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:45:26.239059 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37347df-30be-462b-a528-e4a845014f78 service placement] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:45:26.242539 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c2df2-fc9a-4155-a2c0-cef6abfdf062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba4a0ad60a549bd8255124ffcd83f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:45:26.243130 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c2df2-fc9a-4155-a2c0-cef6abfdf062 service neutron] REQUEST_METHOD: `GET` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:45:26.243397 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c2df2-fc9a-4155-a2c0-cef6abfdf062 service neutron] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:45:26.243659 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c2df2-fc9a-4155-a2c0-cef6abfdf062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:45:26.245295 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-f38c2df2-fc9a-4155-a2c0-cef6abfdf062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:45:26.332189 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c2df2-fc9a-4155-a2c0-cef6abfdf062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:45:26.333608 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c2df2-fc9a-4155-a2c0-cef6abfdf062 service neutron] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:45:26.343148 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 620/1255] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:45:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:45:29.746197 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6ea8c-f9e2-4f45-bfd6-c556702302b1 None None] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:45:29.747158 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=28 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:45:29.748375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6ea8c-f9e2-4f45-bfd6-c556702302b1 None None] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:45:29.748837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6ea8c-f9e2-4f45-bfd6-c556702302b1 None None] PATH_INFO: `/` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:45:29.751160 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 636/1256] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 19:45:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:45:29.774365 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f2a18-e0c0-4613-b6db-77350e000ba9 None None] REQUEST_METHOD: `POST` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:45:29.774868 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f2a18-e0c0-4613-b6db-77350e000ba9 None None] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:45:29.775000 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f2a18-e0c0-4613-b6db-77350e000ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:45:29.814615 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.auth.core [None req-096f2a18-e0c0-4613-b6db-77350e000ba9 None None] MFA Rules not processed for user `35957952c2a142ba868279f19ab4d46d`. Rule list: `[]` (Enabled: `True`). {{(pid=123563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:45:29.815868 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-096f2a18-e0c0-4613-b6db-77350e000ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:45:29.825596 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 621/1257] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 19:45:29 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:45:29.837335 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6ea8c-f9e2-4f45-bfd6-c556702302b1 None None] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:45:29.839710 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-62c6ea8c-f9e2-4f45-bfd6-c556702302b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:45:29.857958 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6ea8c-f9e2-4f45-bfd6-c556702302b1 None None] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:45:29.863264 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de120dc-63b8-4ba0-9f43-642840c724e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35957952c2a142ba868279f19ab4d46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a186fc1651b442d4b704b88a3dddf1b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:45:29.863981 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de120dc-63b8-4ba0-9f43-642840c724e3 service placement] REQUEST_METHOD: `GET` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:45:29.864361 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de120dc-63b8-4ba0-9f43-642840c724e3 service placement] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:45:29.864729 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de120dc-63b8-4ba0-9f43-642840c724e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:45:29.874042 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de120dc-63b8-4ba0-9f43-642840c724e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:45:29.876067 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de120dc-63b8-4ba0-9f43-642840c724e3 service placement] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:45:29.886438 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 637/1258] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 19:45:29 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:45:33.197952 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f2a18-e0c0-4613-b6db-77350e000ba9 None None] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:45:33.200565 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-096f2a18-e0c0-4613-b6db-77350e000ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:45:33.218107 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f2a18-e0c0-4613-b6db-77350e000ba9 None None] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:45:33.223691 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:45:33.224427 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:45:33.224625 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:45:33.224901 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] PATH_INFO: `/v3/users/5f507c90e1b04bb9a3a7bf9ef3802c38` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:45:33.241529 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f507c90e1b04bb9a3a7bf9ef3802c38)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:45:33.242689 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: WARNING py.warnings [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:45:33.242689 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: warnings.warn(msg) Aug 19 19:45:33.242689 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: Aug 19 19:45:33.243937 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:45:33.309333 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f507c90e1b04bb9a3a7bf9ef3802c38'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.328022 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f507c90e1b04bb9a3a7bf9ef3802c38'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.337334 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f507c90e1b04bb9a3a7bf9ef3802c38'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.348083 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f507c90e1b04bb9a3a7bf9ef3802c38'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.348760 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f507c90e1b04bb9a3a7bf9ef3802c38'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.354619 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 622/1259] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Aug 19 19:45:33 2022] DELETE /identity/v3/users/5f507c90e1b04bb9a3a7bf9ef3802c38 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:45:33.543966 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de120dc-63b8-4ba0-9f43-642840c724e3 service placement] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:45:33.556895 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de120dc-63b8-4ba0-9f43-642840c724e3 service placement] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:45:33.623545 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:45:33.624292 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:45:33.624563 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:45:33.624837 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] PATH_INFO: `/v3/projects/472461b3c76443e4bb3f6e527be087fb` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:45:33.637964 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=472461b3c76443e4bb3f6e527be087fb)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:45:33.639425 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: WARNING py.warnings [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:45:33.639425 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: warnings.warn(msg) Aug 19 19:45:33.639425 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: Aug 19 19:45:33.641160 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:45:33.708890 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472461b3c76443e4bb3f6e527be087fb', 'request_id': 'req-92ed9c79-8f27-459e-952a-180efe8beccf'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.722888 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472461b3c76443e4bb3f6e527be087fb', 'request_id': 'req-92ed9c79-8f27-459e-952a-180efe8beccf'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.732188 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472461b3c76443e4bb3f6e527be087fb', 'request_id': 'req-92ed9c79-8f27-459e-952a-180efe8beccf'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.743941 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] The token cache is being invalidate because project 472461b3c76443e4bb3f6e527be087fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=123562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 19:45:33.744226 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.744838 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.746375 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 638/1260] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Aug 19 19:45:33 2022] DELETE /identity/v3/projects/472461b3c76443e4bb3f6e527be087fb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:45:33.750661 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] Authenticating user token {{(pid=123563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:45:33.752109 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.fernet_utils [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:45:33.766458 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7cc77-86d2-4a9a-a25f-2515d5108e97 admin admin] Validating token access rules against request {{(pid=123563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:45:33.786291 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:45:33.829896 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf0462-e68a-40d4-8da3-1a8ac81fb5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:45:33.830566 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf0462-e68a-40d4-8da3-1a8ac81fb5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:45:33.830843 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf0462-e68a-40d4-8da3-1a8ac81fb5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:45:33.831146 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf0462-e68a-40d4-8da3-1a8ac81fb5c0 admin admin] PATH_INFO: `/v3/users/83bb7f167f934240a2530ce096bf0b26` {{(pid=123563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:45:33.844106 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf0462-e68a-40d4-8da3-1a8ac81fb5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bb7f167f934240a2530ce096bf0b26)` {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:45:33.846080 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf0462-e68a-40d4-8da3-1a8ac81fb5c0 admin admin] RBAC: Authorization granted {{(pid=123563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:45:33.894248 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-34cf0462-e68a-40d4-8da3-1a8ac81fb5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bb7f167f934240a2530ce096bf0b26'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.905865 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-34cf0462-e68a-40d4-8da3-1a8ac81fb5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bb7f167f934240a2530ce096bf0b26'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.913888 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-34cf0462-e68a-40d4-8da3-1a8ac81fb5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bb7f167f934240a2530ce096bf0b26'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.920833 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-34cf0462-e68a-40d4-8da3-1a8ac81fb5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bb7f167f934240a2530ce096bf0b26'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.921448 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG keystone.notifications [None req-34cf0462-e68a-40d4-8da3-1a8ac81fb5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bb7f167f934240a2530ce096bf0b26'} {{(pid=123563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:33.927819 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: [pid: 123563|app: 0|req: 623/1261] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Aug 19 19:45:33 2022] DELETE /identity/v3/users/83bb7f167f934240a2530ce096bf0b26 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:45:34.112625 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] Authenticating user token {{(pid=123562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:45:34.114185 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.fernet_utils [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=123562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:45:34.127598 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed9c79-8f27-459e-952a-180efe8beccf admin admin] Validating token access rules against request {{(pid=123562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:45:34.188869 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d26dacccf744cb7a2a26549ace91be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5477f1d1785b40499847c6f71cd220c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:45:34.189571 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:45:34.189847 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:45:34.190286 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] PATH_INFO: `/v3/projects/0b0be1f89866493d8f7b7f6719c2e761` {{(pid=123562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:45:34.202056 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b0be1f89866493d8f7b7f6719c2e761)` {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:45:34.204183 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] RBAC: Authorization granted {{(pid=123562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:45:34.205746 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:45:34.262433 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b0be1f89866493d8f7b7f6719c2e761', 'request_id': 'req-aec38b38-a850-48fb-aa66-99d4cc24c741'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:34.269680 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b0be1f89866493d8f7b7f6719c2e761', 'request_id': 'req-aec38b38-a850-48fb-aa66-99d4cc24c741'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:34.279926 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b0be1f89866493d8f7b7f6719c2e761', 'request_id': 'req-aec38b38-a850-48fb-aa66-99d4cc24c741'} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:34.291357 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] The token cache is being invalidate because project 0b0be1f89866493d8f7b7f6719c2e761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=123562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 19:45:34.291667 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:34.292309 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG keystone.notifications [None req-aec38b38-a850-48fb-aa66-99d4cc24c741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=123562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:45:34.293851 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: [pid: 123562|app: 0|req: 639/1262] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Aug 19 19:45:34 2022] DELETE /identity/v3/projects/0b0be1f89866493d8f7b7f6719c2e761 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:45:43.924474 dv-osbrick-853458-2-ceph devstack@keystone.service[123563]: DEBUG dbcounter [-] [123563] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=123563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:45:44.288504 dv-osbrick-853458-2-ceph devstack@keystone.service[123562]: DEBUG dbcounter [-] [123562] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=123562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}